-- Logs begin at Sun 2022-09-11 00:10:37 UTC, end at Sun 2022-09-11 01:13:01 UTC. -- Sep 11 00:46:55.265030 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Sep 11 00:46:55.272787 dv-cinder-master-3-smb devstack@n-api.service[105506]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 11 00:46:55.275230 dv-cinder-master-3-smb devstack@n-api.service[105506]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 00:46:55 2022] *** Sep 11 00:46:55.275230 dv-cinder-master-3-smb devstack@n-api.service[105506]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 00:46:55.275230 dv-cinder-master-3-smb devstack@n-api.service[105506]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 00:46:55.275230 dv-cinder-master-3-smb devstack@n-api.service[105506]: nodename: dv-cinder-master-3-smb Sep 11 00:46:55.275230 dv-cinder-master-3-smb devstack@n-api.service[105506]: machine: x86_64 Sep 11 00:46:55.275230 dv-cinder-master-3-smb devstack@n-api.service[105506]: clock source: unix Sep 11 00:46:55.275230 dv-cinder-master-3-smb devstack@n-api.service[105506]: pcre jit disabled Sep 11 00:46:55.275230 dv-cinder-master-3-smb devstack@n-api.service[105506]: detected number of CPU cores: 4 Sep 11 00:46:55.275230 dv-cinder-master-3-smb devstack@n-api.service[105506]: current working directory: / Sep 11 00:46:55.275230 dv-cinder-master-3-smb devstack@n-api.service[105506]: detected binary path: /usr/bin/uwsgi-core Sep 11 00:46:55.275230 dv-cinder-master-3-smb devstack@n-api.service[105506]: your processes number limit is 47680 Sep 11 00:46:55.275230 dv-cinder-master-3-smb devstack@n-api.service[105506]: your memory page size is 4096 bytes Sep 11 00:46:55.275230 dv-cinder-master-3-smb devstack@n-api.service[105506]: detected max file descriptor number: 2048 Sep 11 00:46:55.275230 dv-cinder-master-3-smb devstack@n-api.service[105506]: lock engine: pthread robust mutexes Sep 11 00:46:55.276044 dv-cinder-master-3-smb devstack@n-api.service[105506]: thunder lock: enabled Sep 11 00:46:55.276044 dv-cinder-master-3-smb devstack@n-api.service[105506]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 11 00:46:55.276044 dv-cinder-master-3-smb devstack@n-api.service[105506]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 00:46:55.314186 dv-cinder-master-3-smb devstack@n-api.service[105506]: Python main interpreter initialized at 0x563a6b3ce9c0 Sep 11 00:46:55.314186 dv-cinder-master-3-smb devstack@n-api.service[105506]: python threads support enabled Sep 11 00:46:55.314186 dv-cinder-master-3-smb devstack@n-api.service[105506]: your server socket listen backlog is limited to 100 connections Sep 11 00:46:55.314186 dv-cinder-master-3-smb devstack@n-api.service[105506]: your mercy for graceful operations on workers is 90 seconds Sep 11 00:46:55.314571 dv-cinder-master-3-smb devstack@n-api.service[105506]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 00:46:55.314571 dv-cinder-master-3-smb devstack@n-api.service[105506]: *** Operational MODE: preforking *** Sep 11 00:46:55.314843 dv-cinder-master-3-smb devstack@n-api.service[105506]: *** uWSGI is running in multiple interpreter mode *** Sep 11 00:46:55.314843 dv-cinder-master-3-smb devstack@n-api.service[105506]: spawned uWSGI master process (pid: 105506) Sep 11 00:46:55.315060 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Sep 11 00:46:55.315590 dv-cinder-master-3-smb devstack@n-api.service[105506]: spawned uWSGI worker 1 (pid: 105507, cores: 1) Sep 11 00:46:55.319201 dv-cinder-master-3-smb devstack@n-api.service[105506]: spawned uWSGI worker 2 (pid: 105508, cores: 1) Sep 11 00:46:55.319201 dv-cinder-master-3-smb devstack@n-api.service[105506]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 00:46:55.969667 dv-cinder-master-3-smb devstack@n-api.service[105507]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 00:46:55.970310 dv-cinder-master-3-smb devstack@n-api.service[105508]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 00:46:57.041017 dv-cinder-master-3-smb devstack@n-api.service[105508]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:46:57.041017 dv-cinder-master-3-smb devstack@n-api.service[105508]: from cryptography.utils import int_from_bytes Sep 11 00:46:57.041740 dv-cinder-master-3-smb devstack@n-api.service[105507]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:46:57.041740 dv-cinder-master-3-smb devstack@n-api.service[105507]: from cryptography.utils import int_from_bytes Sep 11 00:46:57.042148 dv-cinder-master-3-smb devstack@n-api.service[105508]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:46:57.042148 dv-cinder-master-3-smb devstack@n-api.service[105508]: from cryptography.utils import int_from_bytes Sep 11 00:46:57.042265 dv-cinder-master-3-smb devstack@n-api.service[105507]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:46:57.042265 dv-cinder-master-3-smb devstack@n-api.service[105507]: from cryptography.utils import int_from_bytes Sep 11 00:46:59.534048 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 00:46:59.534700 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 00:46:59.534700 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 00:46:59.535087 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 00:46:59.535385 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 00:46:59.535766 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.536091 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.536409 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.536722 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.537049 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.537358 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.537671 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.537967 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.538291 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.538545 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.538859 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.539208 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.539518 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.539624 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 00:46:59.540009 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.540093 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 00:46:59.540171 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.540384 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 00:46:59.540488 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.540703 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.540827 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 00:46:59.540971 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 00:46:59.541072 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.541309 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.541433 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.541653 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.541796 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.541968 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.542228 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.542386 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.542527 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.542669 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.542827 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.542967 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.543158 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.543338 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.543491 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.543634 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.543799 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.543929 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.544070 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.544201 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.544358 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.544491 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.544672 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.544758 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.544984 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.545078 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.545285 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.545374 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.545592 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.545697 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.545894 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.545981 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.546267 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.546363 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.546601 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.546733 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.546900 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.546986 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.547430 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.547740 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.548040 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.548345 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.548675 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.548983 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.549286 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.549597 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.549898 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.550215 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.550518 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.550928 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.551342 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.551484 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.551650 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.551746 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.551957 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.552090 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.552359 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.552455 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.552663 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.552750 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.552962 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.553081 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.553274 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.553414 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.553586 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.554089 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.554217 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.554475 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.554564 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.554706 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.554847 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.555022 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.555156 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.555385 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.555477 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.555704 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.555800 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.556012 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.556112 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.556266 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.556356 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.556578 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.556665 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.556901 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.556988 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.557204 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.557295 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.557448 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.557541 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.557749 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.557839 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.558009 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.558109 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.558326 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.558419 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.558648 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.558746 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.558959 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.559053 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.559289 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.559381 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.559601 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.559697 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.559908 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.560004 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.560203 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.560289 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.560505 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.560598 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.560800 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.560894 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.561101 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.561187 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.561404 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.561544 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.561704 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.561799 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.562004 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.562107 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.562303 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.562398 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.562613 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.562707 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.562921 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.563011 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.563257 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.563358 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.563571 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.563701 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.563880 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.563991 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.564215 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.564319 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.564496 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.564587 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.564798 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.564899 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.565126 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.565229 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.565434 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.565526 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.565730 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.565815 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.566039 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.566125 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.566348 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.566434 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.566674 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.566772 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.566976 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.567071 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.567248 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.567337 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.567551 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.567635 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.567855 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.567953 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.568169 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.568256 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.568425 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.568519 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.568715 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.568802 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.569016 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.569105 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.569325 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.569419 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.569622 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.569708 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.569920 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.570007 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.570216 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.570310 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.570507 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.570592 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.570803 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.570888 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.571104 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.571218 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.571433 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.571521 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.571727 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.571813 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.572026 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.572135 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.572325 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.572411 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.572620 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.572712 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.572917 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.573004 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.573211 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.573297 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.573505 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.573636 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.573805 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.573902 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.574109 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.574196 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.574404 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.574490 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.574700 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.574788 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.574995 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.575082 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.575316 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.575406 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.575628 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.575726 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.575928 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.576013 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.576224 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.576309 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.576528 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.576619 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.576822 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.576914 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.577117 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.577203 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.577416 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.577502 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.577719 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.577854 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.578016 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.578102 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.578318 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.578417 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.578609 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.578695 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.578904 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.578988 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.579220 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.579323 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.579521 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.579606 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.579817 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.579981 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.580112 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.580205 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.580402 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.580495 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.580696 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.580793 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.580990 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.581075 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.581281 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.581368 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.581575 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.581669 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.581865 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.581951 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.582220 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.582304 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.582539 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.582633 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.582844 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.582936 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.583143 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.583273 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.583533 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.583622 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.583848 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.583977 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:59.584177 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.584316 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.584508 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.584646 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.584825 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.584983 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.585136 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.585294 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.585450 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.585621 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.585765 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.585948 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.586074 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.586263 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.586385 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.586570 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.586694 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.586878 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.587009 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.587214 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.587348 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.587531 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.587674 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.587837 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.587977 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.588143 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.588290 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.588457 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.588611 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.588772 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.588905 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.589097 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.589221 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.589408 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.589545 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.589719 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.589865 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.590032 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.590174 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.590337 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.590513 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.590652 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.590859 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.590979 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.591186 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.591321 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.591519 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.591630 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.591839 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.591980 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.592148 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.592289 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.592456 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.592597 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.592762 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.592915 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.593103 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.593230 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.593415 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.593536 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.593726 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.593841 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.594042 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.594138 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.594352 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.594453 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.594673 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.594759 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.594985 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.595073 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.595321 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.595414 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.595643 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.595790 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.595953 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.596064 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.596256 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.596352 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.596558 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.596645 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.596869 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.596961 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.597165 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.597269 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.597472 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.597558 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.597805 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.597900 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.598115 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.598211 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.598424 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.598508 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.598729 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.598820 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.599033 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.599126 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.599359 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.599485 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.599661 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.599794 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.599963 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.600102 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.600267 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.600408 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.600568 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.600706 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.600884 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.601005 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.601207 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.601292 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.601510 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.601596 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.601840 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.601927 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.602143 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.602230 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.602449 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.602543 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.602757 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.602854 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.603063 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.603149 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.603388 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.603484 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.603695 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.603784 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.603996 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.604082 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.604296 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.604395 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.604592 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.604678 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.604895 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.604988 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.605196 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.605289 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.605493 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.605579 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.605810 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.605904 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.606111 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.606210 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.606410 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.606503 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.606715 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.606799 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.607015 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.607100 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.607348 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.607446 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.607656 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.607750 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.607959 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.608045 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.608262 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.608347 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.608566 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.608659 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.608872 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.608960 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.609186 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.609273 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.609491 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.609577 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.609795 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.609882 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.610117 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.610202 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.610429 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.610527 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.610733 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.610817 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.611037 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.611121 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.611363 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.611461 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.611664 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.611758 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.611963 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.612049 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.612264 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.612358 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.612559 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.612644 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.612854 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.612938 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.613149 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.613241 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.613496 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.613582 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.613795 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.613880 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.614094 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.614182 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.614393 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.614477 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.614692 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.614776 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.614995 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.615082 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.615322 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.615414 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.615669 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.615755 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.615973 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.616063 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.616279 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.616363 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.616574 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.616661 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.616907 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.616995 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.617206 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.617305 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.617543 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.617641 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.617859 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.617953 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.618165 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.618251 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.618473 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.618613 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.618778 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.618864 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.619082 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.619166 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.619411 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.619508 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.619715 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.619808 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.620018 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.620105 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.620321 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.620419 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.620633 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.620717 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.620937 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.621023 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.621250 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.621404 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.621548 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.621641 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.621860 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.621954 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.622160 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.622290 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.622475 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.622563 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.622777 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.622864 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.623086 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.623222 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.623435 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.623527 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.623748 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.623834 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.624054 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.624142 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.624362 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.624447 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.624663 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.624755 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.624966 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.625053 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.625266 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.625352 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.625569 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.625665 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.625873 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.625967 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.626176 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.626260 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.626484 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.626581 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.626785 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.626872 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.627095 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.627200 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.627418 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.627515 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.627731 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.627828 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.628031 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.628115 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.628343 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.628439 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.628638 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.628733 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.628943 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.629076 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.629316 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.629410 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.629631 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.629716 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.629945 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.630093 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.630254 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.630343 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.630556 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.630719 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.630859 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.631028 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.631238 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.631363 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.631494 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.631699 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.631792 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.631971 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.632100 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.632273 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.632402 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.632577 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.632698 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.632888 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.632988 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.633192 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.633286 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.633497 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.633591 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.633796 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.633884 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.634104 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.634190 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.634407 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.634494 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.634705 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.634803 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.635001 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.635092 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.635331 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.635433 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.635650 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.635737 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.635954 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.636041 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.636270 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.636357 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.636577 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.636664 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.636875 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.636967 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.637172 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.637268 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.637490 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.637576 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.637792 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.637877 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.638089 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.638182 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.638385 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.638470 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.638684 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.638769 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.639000 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.639093 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.639332 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.639432 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.639631 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.639725 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.639934 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.640028 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.640244 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.640341 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.640546 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.640632 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.640850 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.640945 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.641148 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.641234 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.641448 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.641533 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.641754 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.641893 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.642059 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.642154 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.642359 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.642479 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.642664 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.642755 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.642967 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.643051 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.643291 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.643379 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.643598 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.643686 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.643910 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.643995 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.644211 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.644306 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.644516 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.644827 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.645163 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.645480 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.645808 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.646151 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.646473 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.646826 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.647134 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.647482 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.647790 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.648105 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.648412 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.648716 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.649120 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.649228 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.649310 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.649388 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.649637 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.649768 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.649937 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.650069 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.650248 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.650516 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.650671 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.650841 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.650985 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.651147 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.651340 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.651445 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.651540 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.651862 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.652012 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.652113 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.652205 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.652383 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.652515 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.652686 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.652818 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.653005 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.653138 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.653299 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.653403 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.653599 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.653689 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.653903 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.653994 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.654203 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.654302 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.654541 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.654629 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.654842 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.654929 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.655140 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.655272 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.655467 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.655557 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.655774 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.655864 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.656078 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.656176 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.656377 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.656465 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.656678 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.656767 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.656984 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.657076 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.657299 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.657401 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.657584 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.657669 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.657889 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.657974 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.658187 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.658271 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.658484 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.658574 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.658793 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.658879 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.659092 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.659195 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.659417 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.659505 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.659718 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.659804 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.660015 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.660106 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.660373 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.660467 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.660677 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.660762 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.660990 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.661075 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.661299 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.661392 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.661602 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.661780 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.661898 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.662086 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.662199 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.662408 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.662495 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.662709 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.662801 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.663009 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.663095 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.663335 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.663426 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.663646 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.663759 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.663956 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.664066 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.664251 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.664345 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.664557 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.664640 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.664858 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.664951 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.665161 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.665245 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.665464 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.665548 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.665760 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.665859 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.666064 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.666149 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.666361 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.666445 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.666659 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.666752 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.666962 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.667046 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.667283 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.667372 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.667585 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.667672 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.667890 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.667976 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.668191 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.668274 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.668512 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.668597 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.668817 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.669092 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.669177 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.669416 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.669618 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.669714 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.670011 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.670163 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.670319 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.670624 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.670722 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.670928 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.671221 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.671310 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.671544 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.671750 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.671838 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.672152 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.672277 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.672459 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.672764 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.672859 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.673069 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.673311 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.673398 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.673700 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.673872 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.674002 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.674361 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.674446 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.674667 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.674909 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.675003 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.675313 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.675570 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.675656 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.675961 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.676143 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.676277 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.676579 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.676672 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.676891 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.677215 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.677426 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.677524 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.677732 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.677901 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.678074 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.678268 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.678387 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.678686 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.679254 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.679380 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.679639 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.679725 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.680006 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.680185 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.680328 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.680497 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.680636 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.680924 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.681166 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.681255 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.681477 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.681571 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.681788 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.681873 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.682100 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.682195 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.682406 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.682491 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.682712 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.682795 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.683015 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.683101 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.683344 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.683444 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.683655 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.683741 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.683961 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.684048 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.684260 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.684344 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.684563 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.684655 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.684861 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.684952 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.685177 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.685268 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.685489 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.685582 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.685790 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.685877 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.686098 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.686191 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.686399 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.686494 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.686705 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.686792 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.687005 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.687091 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.687354 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.687476 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.687669 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.687785 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.687972 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.688235 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.688349 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.688659 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.688792 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.688970 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.689273 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.689365 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.689572 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.689862 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.689948 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.690182 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.690267 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.690490 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.690589 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.690801 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.690895 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.691115 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.691238 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.691463 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.691595 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.691837 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.691925 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.692211 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.692473 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.692570 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.692865 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.692952 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.693172 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.693267 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.693482 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.693577 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.693807 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.693895 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.694112 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.694205 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.694415 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.694508 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.694716 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.694808 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.695018 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.695101 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.695345 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.695446 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.695652 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.695817 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.696003 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.696302 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.696455 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.696621 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.696924 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.697008 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.697223 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.697524 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.697617 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.697823 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.698125 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.698279 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.698467 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.698608 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.698867 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.698954 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.699269 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.699405 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.699584 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.699670 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.699883 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.699981 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.700187 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.700279 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.700490 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.700582 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.700801 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.700888 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.701110 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.701203 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.701408 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.701500 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.701736 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.701819 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.702140 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.702225 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.702471 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.702713 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.702808 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.703062 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.703307 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.703395 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.703680 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.703828 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.703999 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.704297 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.704383 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.704595 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.704836 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.704921 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.705194 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.705368 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.705563 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.705696 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.705878 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.706008 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.706284 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.706378 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.706591 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.706678 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.706889 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.706988 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.707283 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.707372 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.707598 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.707903 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.708210 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.708536 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.708840 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.709150 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.709461 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.709774 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.709968 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.710064 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.710302 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.710398 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.710675 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.710979 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.711320 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.711636 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.711960 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.712280 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.712584 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.712812 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.712905 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.713199 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.713502 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.713805 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.714113 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.714455 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.714756 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.715077 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.715320 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.715442 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.715669 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.715761 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.715991 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.716100 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.716318 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.716411 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.716638 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.716729 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.716970 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.717074 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.717298 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.717389 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.717612 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.717700 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.717971 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.718114 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.718242 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.718337 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.718564 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.718708 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.718850 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.718949 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.719194 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.719348 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.719476 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.719621 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.719803 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.719936 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.720112 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.720247 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.720383 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.720547 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.720698 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.720865 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.721013 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.721189 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.721334 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.721472 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.721571 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.721797 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.721943 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.722108 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.722240 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.722413 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.722546 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.722682 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.722784 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.723074 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.723208 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.723407 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.723501 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.723704 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.723816 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.724028 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.724191 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.724326 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.724651 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.724802 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.724969 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.725111 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.725282 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.725429 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.725604 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.725747 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.725901 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.726032 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.726214 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.726353 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.726529 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.726664 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.726846 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.726985 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.727155 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.727338 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.727494 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.727643 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.727812 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.727963 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.728130 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.728270 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.728570 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.728700 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.728875 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.729027 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.729179 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.729340 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.729516 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.729650 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.729817 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.729961 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.730133 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.730276 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.730461 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.730587 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.730787 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.730882 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.731096 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.731217 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.731457 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.731544 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.731786 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.731874 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.732102 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.732199 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.732408 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.732493 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.732722 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.732808 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.733041 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.733126 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.733341 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.733471 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.733639 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.733728 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.733943 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.734027 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.734240 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.734338 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.734540 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.734626 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.734838 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.734925 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.735140 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.735260 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.735465 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.735550 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.735764 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.735852 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.736063 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.736157 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.736381 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.736467 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.736677 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.736762 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.736990 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.737077 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.737294 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.737386 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.737595 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.737680 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.737895 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.737989 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.738191 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.738284 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.738528 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.738613 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.738845 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.738931 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.739165 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.739323 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.739507 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.739641 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.739822 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.739917 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.740136 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.740223 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.740453 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.740610 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.740765 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.740973 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.741084 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.741288 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.741374 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.741620 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.741715 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.741944 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.742037 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.742263 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.742349 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.742575 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.742661 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.742884 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.742968 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.743264 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.743366 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.743530 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.743767 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.743853 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.744092 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.744178 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.744401 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.744487 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.744707 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.744791 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.745010 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.745095 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.745319 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.745405 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.745621 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.745705 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.745925 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.746016 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.746229 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.746316 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.746533 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.746757 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.746843 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.747111 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.747227 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.747455 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.747542 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.747782 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.747866 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.748108 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.748203 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.748422 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.748514 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.748726 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.748811 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.749032 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.749117 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.749339 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.749434 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.749641 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.749734 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.749956 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.750042 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.750266 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.750350 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.750569 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.750662 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.750875 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.750960 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.751205 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.751294 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.751511 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.751607 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.751811 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.751895 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.752116 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.752199 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.752415 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.752501 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.752720 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.752904 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.753028 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.753114 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.753331 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.753417 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.753635 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.753721 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.753944 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.754029 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.754300 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.754387 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.754603 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.754689 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.754909 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.755004 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.755235 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.755335 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.755560 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.755689 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.755857 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.756146 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.756233 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.756456 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.756543 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.756764 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.756857 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.757091 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.757190 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.757411 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.757497 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.757713 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.757799 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.758025 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.758110 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.758328 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.758412 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.758632 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.758726 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.758927 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.759019 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.759255 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.759346 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.759562 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.759660 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.759861 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.759948 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.760170 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.760253 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.760470 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.760569 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.760768 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.760852 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.761080 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.761328 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.761416 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.761661 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.761893 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.761987 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.762240 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.762326 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.762552 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.762641 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.762869 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.762954 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.763197 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.763299 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.763504 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.763590 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.763811 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.763902 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.764124 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.764216 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.764426 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.764510 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.764725 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.764810 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.765031 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.765123 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.765334 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.765428 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.765633 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.765718 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.765931 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.766024 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.766237 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.766320 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.766536 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.766619 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.766834 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.766927 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.767137 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.767256 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.767461 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.767548 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.767764 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.767857 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.768073 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.768166 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.768371 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.768456 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.768672 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.768758 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.768977 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.769061 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.769276 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.769363 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.769575 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.769662 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.769901 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.769986 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.770204 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.770290 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.770509 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.770596 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.770806 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.770890 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.771114 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.771232 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.771532 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.771662 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.771836 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.771920 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.772159 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.772251 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.772467 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.772553 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.772766 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.773081 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.773209 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.773383 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.773473 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.773679 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.773764 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.773992 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.774084 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.774295 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.774389 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.774610 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.774697 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.774916 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.775001 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.775252 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.775342 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.775594 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.775681 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.775905 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.776002 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.776230 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.776429 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.776569 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.776760 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.776900 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.777078 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.777224 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.777404 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.777530 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.777728 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.777824 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.778033 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.778127 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.778331 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.778424 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.778628 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.778727 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.778948 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.779041 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.779277 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.779367 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.779586 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.779685 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.779891 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.779977 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.780193 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.780320 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.780494 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.780588 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.780795 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.780880 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.781096 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.781179 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.781397 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.781489 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.781693 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.781777 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.781992 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.782077 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.782290 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.782383 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.782589 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.782680 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.782886 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.782971 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.783195 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.783323 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.783513 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.783609 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.783815 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.783900 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.784166 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.784270 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.784413 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.784499 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.784712 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.784812 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.785013 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.785108 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.785377 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.785462 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.785683 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.785781 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.785986 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.786078 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.786288 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.786373 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.786622 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.786714 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.786942 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.787027 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.787270 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.787359 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.787595 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.787682 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.787914 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.788226 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.788310 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.788536 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.788630 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.788869 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.788962 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.789175 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.789269 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.789481 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.789575 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.789791 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.789878 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.790098 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.790185 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.790402 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.790496 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.790706 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.790799 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.791007 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.791091 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.791357 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.791447 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.791659 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.791743 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.791984 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.792071 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.792303 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.792391 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.792602 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.792686 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.792902 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.792987 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.793199 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.793286 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.793501 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.793590 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.793813 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.793906 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.794122 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.794207 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.794424 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.794508 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.794722 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.794815 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.795024 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.795110 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.795360 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.795447 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.795659 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.795761 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.795961 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.796047 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.796258 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.796342 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.796560 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.796647 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.796858 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.796944 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.797156 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.797242 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.797453 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.797548 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.797753 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.797838 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.798047 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.798131 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.798343 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.798429 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.798645 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.798730 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.798942 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.799061 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.799263 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.799422 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.799559 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.799736 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.799856 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.800052 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.800148 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.800356 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.800479 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.800601 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 00:46:59.800769 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.801103 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.801418 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.801721 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.802031 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.802446 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.802764 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.803081 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.803490 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.804161 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.804488 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.804793 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.805097 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.805402 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.805704 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.806004 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.806305 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.806624 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.806943 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.807266 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.807593 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.807905 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.808222 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.808531 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.808836 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.809159 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.809464 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.809770 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.810073 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.810378 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.810684 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.810992 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.811323 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.811633 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.811943 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.812251 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.812572 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.812901 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.813209 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.813529 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.813849 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.814188 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.814493 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.814827 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.815147 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.815478 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.815785 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.816084 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:59.816321 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 00:46:59.955876 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO dbcounter [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Registered counter for database nova_api Sep 11 00:46:59.971210 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO dbcounter [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] Registered counter for database nova_api Sep 11 00:46:59.979120 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_db.sqlalchemy.engines [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:46:59.986525 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writer thread running {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:46:59.993736 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG oslo_db.sqlalchemy.engines [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:47:00.000542 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writer thread running {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:47:00.044907 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.context [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8719ce5-7462-4db4-8ae0-e38f988a1e8a(cell1) {{(pid=105507) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 00:47:00.048799 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:47:00.049273 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:47:00.050840 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:47:00.051659 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:47:00.052110 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:47:00.054458 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:47:00.056539 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO dbcounter [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Registered counter for database nova_cell0 Sep 11 00:47:00.056976 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.context [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8719ce5-7462-4db4-8ae0-e38f988a1e8a(cell1) {{(pid=105508) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 00:47:00.060607 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO dbcounter [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Registered counter for database nova_cell1 Sep 11 00:47:00.060813 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG oslo_concurrency.lockutils [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:47:00.061252 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG oslo_concurrency.lockutils [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:47:00.062832 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG oslo_concurrency.lockutils [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:47:00.063573 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG oslo_concurrency.lockutils [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:47:00.064005 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG oslo_concurrency.lockutils [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:47:00.065942 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG oslo_concurrency.lockutils [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:47:00.067917 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_db.sqlalchemy.engines [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:47:00.068241 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO dbcounter [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] Registered counter for database nova_cell0 Sep 11 00:47:00.069780 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_db.sqlalchemy.engines [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:47:00.072503 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO dbcounter [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] Registered counter for database nova_cell1 Sep 11 00:47:00.075536 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writer thread running {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:47:00.079517 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG oslo_db.sqlalchemy.engines [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:47:00.081631 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG oslo_db.sqlalchemy.engines [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:47:00.086553 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writer thread running {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:47:00.089178 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writer thread running {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:47:00.212826 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writer thread running {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:47:00.223083 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO dbcounter [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Registered counter for database nova_cell0 Sep 11 00:47:00.231693 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO dbcounter [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] Registered counter for database nova_cell0 Sep 11 00:47:00.232777 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_db.sqlalchemy.engines [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:47:00.239123 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writer thread running {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:47:00.239799 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG oslo_db.sqlalchemy.engines [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:47:00.244779 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writer thread running {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:47:00.572899 dv-cinder-master-3-smb devstack@n-api.service[105508]: WARNING keystonemiddleware.auth_token [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 00:47:00.575088 dv-cinder-master-3-smb devstack@n-api.service[105507]: WARNING keystonemiddleware.auth_token [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 00:47:00.580151 dv-cinder-master-3-smb devstack@n-api.service[105508]: WARNING keystonemiddleware.auth_token [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 00:47:00.582420 dv-cinder-master-3-smb devstack@n-api.service[105507]: WARNING keystonemiddleware.auth_token [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 00:47:00.924326 dv-cinder-master-3-smb devstack@n-api.service[105508]: WARNING keystonemiddleware.auth_token [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 00:47:00.925092 dv-cinder-master-3-smb devstack@n-api.service[105507]: WARNING keystonemiddleware.auth_token [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 00:47:00.930834 dv-cinder-master-3-smb devstack@n-api.service[105508]: WARNING keystonemiddleware.auth_token [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 00:47:00.931465 dv-cinder-master-3-smb devstack@n-api.service[105507]: WARNING keystonemiddleware.auth_token [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 00:47:00.936079 dv-cinder-master-3-smb devstack@n-api.service[105508]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563a6b3ce9c0 pid: 105508 (default app) Sep 11 00:47:00.936746 dv-cinder-master-3-smb devstack@n-api.service[105507]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563a6b3ce9c0 pid: 105507 (default app) Sep 11 00:47:00.938168 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:47:00.939408 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-a887f2cf-5fb5-45b7-af9f-dfcf99d39864 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Sep 11 00:47:00.939804 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Sun Sep 11 00:47:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:48:22.621960 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:48:22.624012 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002825 Sep 11 00:48:22.624637 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 931 bytes} [Sun Sep 11 00:48:22 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:48:22.636920 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_api:SELECT=3 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:22.638057 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_cell0:SELECT=3 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:22.640586 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_cell1:SELECT=3 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:22.642133 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:23.517754 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-25f22a6f-dded-4767-b32a-db7009b6dc19 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:48:23.549998 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-25f22a6f-dded-4767-b32a-db7009b6dc19 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918876 Sep 11 00:48:23.550585 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Sep 11 00:48:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:48:26.121638 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:48:26.122702 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-6b0b949f-3272-4471-97b2-f8723b36ec29 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 11 00:48:26.123469 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 2/4] 10.222.0.23 () {54 vars in 931 bytes} [Sun Sep 11 00:48:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:48:26.576191 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-3aae613e-e155-4e5c-ab71-e58650e2c2a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "name": "cirros256", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:26.625449 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-3aae613e-e155-4e5c-ab71-e58650e2c2a0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.495759 Sep 11 00:48:26.626134 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 3/5] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Sep 11 00:48:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:48:26.640611 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_api:SELECT=3 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:26.641562 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_cell0:SELECT=3 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:26.643549 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_cell1:SELECT=3 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:26.644352 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:26.848260 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-ab9bdc59-173c-4fdf-8acf-27af6a9ef3d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:26.918482 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-ab9bdc59-173c-4fdf-8acf-27af6a9ef3d9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283844 Sep 11 00:48:26.919100 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 3/6] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Sep 11 00:48:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:48:29.522585 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-3aae613e-e155-4e5c-ab71-e58650e2c2a0 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:48:29.523858 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-3aae613e-e155-4e5c-ab71-e58650e2c2a0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001742 Sep 11 00:48:29.524344 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 4/7] 10.222.0.23 () {54 vars in 931 bytes} [Sun Sep 11 00:48:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:48:30.196602 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-18dc525d-7a94-4b0a-9fa0-266706638453 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:30.238827 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-18dc525d-7a94-4b0a-9fa0-266706638453 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.707987 Sep 11 00:48:30.243311 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 4/8] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Sep 11 00:48:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:48:30.251548 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-824c9a2a-5724-4b6c-a3e1-e0045da0bc84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:30.296795 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-824c9a2a-5724-4b6c-a3e1-e0045da0bc84 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049161 Sep 11 00:48:30.297638 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 5/9] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Sep 11 00:48:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:48:32.885492 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-18dc525d-7a94-4b0a-9fa0-266706638453 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:48:32.886399 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-18dc525d-7a94-4b0a-9fa0-266706638453 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 11 00:48:32.886796 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 931 bytes} [Sun Sep 11 00:48:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:48:33.310536 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-6a478bca-3bfe-4fc7-ace1-404932b391bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "d2", "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:33.330274 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-6a478bca-3bfe-4fc7-ace1-404932b391bd admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437257 Sep 11 00:48:33.330861 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 6/11] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Sep 11 00:48:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 00:48:33.343054 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-d0df3622-891e-4f83-9c36-7744f9606ae3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:33.371554 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-d0df3622-891e-4f83-9c36-7744f9606ae3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032119 Sep 11 00:48:33.372489 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 6/12] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Sep 11 00:48:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:48:36.002863 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-6a478bca-3bfe-4fc7-ace1-404932b391bd admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:48:36.004037 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-6a478bca-3bfe-4fc7-ace1-404932b391bd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001651 Sep 11 00:48:36.004635 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 7/13] 10.222.0.23 () {54 vars in 931 bytes} [Sun Sep 11 00:48:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:48:36.429248 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-982362bc-ec3e-497b-8755-a075497f9734 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:36.450480 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-982362bc-ec3e-497b-8755-a075497f9734 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439479 Sep 11 00:48:36.451350 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 7/14] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Sep 11 00:48:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:48:36.463813 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-51656617-57b4-4a53-921c-327fcc385be9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:36.492478 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-51656617-57b4-4a53-921c-327fcc385be9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032484 Sep 11 00:48:36.493509 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 8/15] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Sep 11 00:48:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:48:39.103390 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-982362bc-ec3e-497b-8755-a075497f9734 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:48:39.104423 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-982362bc-ec3e-497b-8755-a075497f9734 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 11 00:48:39.104822 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 8/16] 10.222.0.23 () {54 vars in 931 bytes} [Sun Sep 11 00:48:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:48:39.545893 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-f8691d7c-3282-48dd-93fa-20ec97141a62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:39.566481 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-f8691d7c-3282-48dd-93fa-20ec97141a62 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455341 Sep 11 00:48:39.567120 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 9/17] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Sep 11 00:48:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:48:39.579468 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-3cdc5dbd-9e2f-4092-b176-b59881c219b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:39.607324 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-3cdc5dbd-9e2f-4092-b176-b59881c219b7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031609 Sep 11 00:48:39.607946 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 9/18] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Sep 11 00:48:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:48:42.950182 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-f8691d7c-3282-48dd-93fa-20ec97141a62 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:48:42.951432 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-f8691d7c-3282-48dd-93fa-20ec97141a62 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 Sep 11 00:48:42.951850 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 10/19] 10.222.0.23 () {54 vars in 931 bytes} [Sun Sep 11 00:48:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:48:43.396998 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-3f8691ba-9971-432a-a541-cd8770cf50e6 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:48:43.424310 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-3f8691ba-9971-432a-a541-cd8770cf50e6 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.465582 Sep 11 00:48:43.424799 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 10/20] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Sep 11 00:48:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:48:46.011631 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-f8691d7c-3282-48dd-93fa-20ec97141a62 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:48:46.012653 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-f8691d7c-3282-48dd-93fa-20ec97141a62 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Sep 11 00:48:46.013023 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 11/21] 10.222.0.23 () {54 vars in 931 bytes} [Sun Sep 11 00:48:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:48:46.422627 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-c89f302c-1df9-4b20-a914-f0651abefd8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:46.444740 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-c89f302c-1df9-4b20-a914-f0651abefd8e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.425567 Sep 11 00:48:46.445441 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 11/22] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Sep 11 00:48:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:48:46.458500 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-bcc9926b-fe5c-4b46-98fe-59cc9f9066e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:46.495992 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-bcc9926b-fe5c-4b46-98fe-59cc9f9066e9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041690 Sep 11 00:48:46.496573 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 12/23] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Sep 11 00:48:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:48:49.059459 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-c89f302c-1df9-4b20-a914-f0651abefd8e admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:48:49.060586 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-c89f302c-1df9-4b20-a914-f0651abefd8e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Sep 11 00:48:49.061465 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 931 bytes} [Sun Sep 11 00:48:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:48:49.456287 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-cef5f795-4e89-4875-8dbb-70f67c15cc07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:49.479139 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-cef5f795-4e89-4875-8dbb-70f67c15cc07 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.411736 Sep 11 00:48:49.487262 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 13/25] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Sep 11 00:48:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:48:49.492322 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-373a18f0-8414-4d69-8e63-5dcdf4494ace admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:49.516778 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-373a18f0-8414-4d69-8e63-5dcdf4494ace admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028239 Sep 11 00:48:49.517358 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 13/26] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Sep 11 00:48:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:48:52.126059 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-cef5f795-4e89-4875-8dbb-70f67c15cc07 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:48:52.127817 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-cef5f795-4e89-4875-8dbb-70f67c15cc07 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002153 Sep 11 00:48:52.128217 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 14/27] 10.222.0.23 () {54 vars in 931 bytes} [Sun Sep 11 00:48:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:48:52.670618 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-8545d8ee-7d59-4c53-892e-47fd6aaa188a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "ram": 4096, "name": "m1.medium", "id": "3"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:52.756558 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-8545d8ee-7d59-4c53-892e-47fd6aaa188a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.621938 Sep 11 00:48:52.757328 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 14/28] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Sep 11 00:48:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 00:48:52.770197 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-ff3184bd-b100-4329-84b0-cb192f374aec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:52.775198 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:52.808472 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-ff3184bd-b100-4329-84b0-cb192f374aec admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042519 Sep 11 00:48:52.809532 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 15/29] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Sep 11 00:48:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:48:55.409155 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-8545d8ee-7d59-4c53-892e-47fd6aaa188a admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:48:55.410165 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-8545d8ee-7d59-4c53-892e-47fd6aaa188a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Sep 11 00:48:55.410557 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 15/30] 10.222.0.23 () {54 vars in 931 bytes} [Sun Sep 11 00:48:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:48:55.840880 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-b4650cc0-9fc0-45d2-baf6-6ad917e261d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "vcpus": 4, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:55.862658 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-b4650cc0-9fc0-45d2-baf6-6ad917e261d3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.445600 Sep 11 00:48:55.863527 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 16/31] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Sep 11 00:48:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:48:55.875899 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-d61c22aa-0762-466a-a173-862ee44340a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:55.904070 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-d61c22aa-0762-466a-a173-862ee44340a5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032041 Sep 11 00:48:55.904951 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 16/32] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Sep 11 00:48:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:48:58.562947 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-b4650cc0-9fc0-45d2-baf6-6ad917e261d3 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:48:58.563908 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-b4650cc0-9fc0-45d2-baf6-6ad917e261d3 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 11 00:48:58.564319 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 17/33] 10.222.0.23 () {54 vars in 931 bytes} [Sun Sep 11 00:48:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:48:59.004684 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-bd692d96-5f21-48a5-9804-d2c7152ddcef admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "swap": 0, "vcpus": 8}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:59.012123 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:59.026677 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-bd692d96-5f21-48a5-9804-d2c7152ddcef admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.456311 Sep 11 00:48:59.027444 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 17/34] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Sep 11 00:48:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:48:59.039493 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-87a0616e-08ac-4cee-aa1b-326e34e5f7a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:48:59.067684 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-87a0616e-08ac-4cee-aa1b-326e34e5f7a1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031826 Sep 11 00:48:59.075381 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 18/35] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Sep 11 00:48:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:49:15.445506 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-bd692d96-5f21-48a5-9804-d2c7152ddcef admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:15.447086 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-bd692d96-5f21-48a5-9804-d2c7152ddcef admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002294 Sep 11 00:49:15.447804 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 18/36] 10.222.0.23 () {54 vars in 931 bytes} [Sun Sep 11 00:49:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:49:15.465360 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:15.887121 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-621ec93e-43d1-44a3-986d-4df5ae7d961a admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:15.907493 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-621ec93e-43d1-44a3-986d-4df5ae7d961a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.449532 Sep 11 00:49:15.908045 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Sep 11 00:49:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:49:17.266109 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-bd692d96-5f21-48a5-9804-d2c7152ddcef admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:17.267488 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-bd692d96-5f21-48a5-9804-d2c7152ddcef admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001762 Sep 11 00:49:17.267990 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 19/38] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Sep 11 00:49:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:49:17.830923 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-fac75091-940f-4e1a-886c-4d797e22195d admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:17.836592 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.wsgi [None req-fac75091-940f-4e1a-886c-4d797e22195d admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-fac75091-940f-4e1a-886c-4d797e22195d admin admin] Request method failure captured: Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: Accept: application/json Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: Accept-Encoding: gzip, deflate Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: Connection: keep-alive Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: Content-Length: 0 Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: Host: 10.222.0.23 Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: Openstack-Api-Version: compute 2.92 Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: Openstack-System-Scope: None Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: User-Agent: python-novaclient Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Auth-Token: gAAAAABjHTCNtuyZh_zTnAvtCHjj2gK2yhAFoaZpvHS-WQU4M1QfBKpDL_3ZslG0avQ0pQd3tmvhQcUpwLRgHjKJdkJ85S8jivF8afdc9hcBZT8JciefarVNsh-KWBjoMrySfo3CTOMtpDFxsEGBbaO5KqiYQzFGmqVIAwuQDXVwPPb1CRnCjPw Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Domain-Id: None Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Domain-Name: None Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Identity-Status: Confirmed Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Is-Admin-Project: True Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Project-Domain-Id: default Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Project-Domain-Name: Default Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Project-Id: 857538f273814e30bf74c0248d309754 Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Project-Name: admin Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Role: member,admin,reader Sep 11 00:49:17.839855 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Roles: member,admin,reader Sep 11 00:49:17.841359 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/857538f273814e30bf74c0248d309754"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/857538f273814e30bf74c0248d309754"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/857538f273814e30bf74c0248d309754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_857538f273814e30bf74c0248d309754", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:49:17.841359 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Tenant: admin Sep 11 00:49:17.841359 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Tenant-Id: 857538f273814e30bf74c0248d309754 Sep 11 00:49:17.841359 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Tenant-Name: admin Sep 11 00:49:17.841359 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User: admin Sep 11 00:49:17.841359 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User-Domain-Id: default Sep 11 00:49:17.841359 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User-Domain-Name: Default Sep 11 00:49:17.841359 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User-Id: cf7ec619bcef4004bcdaf4a26a07260b Sep 11 00:49:17.841359 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User-Name: admin Sep 11 00:49:17.841359 dv-cinder-master-3-smb devstack@n-api.service[105508]: method: > Sep 11 00:49:17.841359 dv-cinder-master-3-smb devstack@n-api.service[105508]: exception: Flavor 42 could not be found. Sep 11 00:49:17.841359 dv-cinder-master-3-smb devstack@n-api.service[105508]: action_args: {'id': '42'} Sep 11 00:49:17.841359 dv-cinder-master-3-smb devstack@n-api.service[105508]: {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:49:17.841359 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:49:17.843858 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:17.845166 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-fac75091-940f-4e1a-886c-4d797e22195d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:49:17.846672 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-fac75091-940f-4e1a-886c-4d797e22195d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.439281 Sep 11 00:49:17.846672 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1190 bytes} [Sun Sep 11 00:49:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:17.851810 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-7b346a92-f83e-4fd1-9a00-6ad554d69312 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:17.874484 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-7b346a92-f83e-4fd1-9a00-6ad554d69312 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026319 Sep 11 00:49:17.875018 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Sep 11 00:49:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:49:17.888939 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-6c85a564-26ec-45ac-8a5a-ab70912a403d admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:17.917497 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-6c85a564-26ec-45ac-8a5a-ab70912a403d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.035819 Sep 11 00:49:17.918026 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 21/41] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Sep 11 00:49:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:49:17.927927 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-c9dbc653-2c5b-4756-aa2a-8636b362940e admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:17.934155 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.wsgi [None req-c9dbc653-2c5b-4756-aa2a-8636b362940e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-c9dbc653-2c5b-4756-aa2a-8636b362940e admin admin] Request method failure captured: Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: Accept: application/json Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: Accept-Encoding: gzip, deflate Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: Connection: keep-alive Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: Content-Length: 0 Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: Host: 10.222.0.23 Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: Openstack-Api-Version: compute 2.92 Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: Openstack-System-Scope: None Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: User-Agent: python-novaclient Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Auth-Token: gAAAAABjHTCNtuyZh_zTnAvtCHjj2gK2yhAFoaZpvHS-WQU4M1QfBKpDL_3ZslG0avQ0pQd3tmvhQcUpwLRgHjKJdkJ85S8jivF8afdc9hcBZT8JciefarVNsh-KWBjoMrySfo3CTOMtpDFxsEGBbaO5KqiYQzFGmqVIAwuQDXVwPPb1CRnCjPw Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Domain-Id: None Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Domain-Name: None Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Identity-Status: Confirmed Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Is-Admin-Project: True Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Project-Domain-Id: default Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Project-Domain-Name: Default Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Project-Id: 857538f273814e30bf74c0248d309754 Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Project-Name: admin Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Role: member,admin,reader Sep 11 00:49:17.937538 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Roles: member,admin,reader Sep 11 00:49:17.939104 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/857538f273814e30bf74c0248d309754"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/857538f273814e30bf74c0248d309754"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/857538f273814e30bf74c0248d309754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_857538f273814e30bf74c0248d309754", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:49:17.939104 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Tenant: admin Sep 11 00:49:17.939104 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Tenant-Id: 857538f273814e30bf74c0248d309754 Sep 11 00:49:17.939104 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Tenant-Name: admin Sep 11 00:49:17.939104 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User: admin Sep 11 00:49:17.939104 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User-Domain-Id: default Sep 11 00:49:17.939104 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User-Domain-Name: Default Sep 11 00:49:17.939104 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User-Id: cf7ec619bcef4004bcdaf4a26a07260b Sep 11 00:49:17.939104 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User-Name: admin Sep 11 00:49:17.939104 dv-cinder-master-3-smb devstack@n-api.service[105507]: method: > Sep 11 00:49:17.939104 dv-cinder-master-3-smb devstack@n-api.service[105507]: exception: Flavor 42 could not be found. Sep 11 00:49:17.939104 dv-cinder-master-3-smb devstack@n-api.service[105507]: action_args: {'id': '42'} Sep 11 00:49:17.939104 dv-cinder-master-3-smb devstack@n-api.service[105507]: {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:49:17.939104 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:49:17.940196 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:17.942009 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-c9dbc653-2c5b-4756-aa2a-8636b362940e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:49:17.943261 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-c9dbc653-2c5b-4756-aa2a-8636b362940e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015027 Sep 11 00:49:17.943261 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1190 bytes} [Sun Sep 11 00:49:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:19.194198 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-6c85a564-26ec-45ac-8a5a-ab70912a403d admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:19.195280 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-6c85a564-26ec-45ac-8a5a-ab70912a403d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 11 00:49:19.195679 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Sep 11 00:49:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:49:19.746368 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-1bbcb005-21f2-4df5-abb7-fe7ce09d62a4 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:19.751735 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.wsgi [None req-1bbcb005-21f2-4df5-abb7-fe7ce09d62a4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-1bbcb005-21f2-4df5-abb7-fe7ce09d62a4 admin admin] Request method failure captured: Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: Accept: application/json Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: Accept-Encoding: gzip, deflate Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: Connection: keep-alive Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: Content-Length: 0 Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: Host: 10.222.0.23 Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: Openstack-Api-Version: compute 2.92 Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: Openstack-System-Scope: None Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: User-Agent: python-novaclient Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Auth-Token: gAAAAABjHTCPzIfUp8KX57g3ccvRdWtR9AeZZBWfzlw1sQFr4x0zd8cAQxkbswpp_rXFSOXU-ZgX7d9UsqF7OMekXrKp4sdzDns4McfPtsLR4Z0bmF4TCfsoRGei1FMscZqpHSoukQK0Wg7DRJQN89NTmQG_h2eJONfx4iIaWLMqUKnJwyieGC8 Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Domain-Id: None Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Domain-Name: None Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Identity-Status: Confirmed Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Is-Admin-Project: True Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Project-Domain-Id: default Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Project-Domain-Name: Default Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Project-Id: 857538f273814e30bf74c0248d309754 Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Project-Name: admin Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Role: member,admin,reader Sep 11 00:49:19.753323 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Roles: member,admin,reader Sep 11 00:49:19.754736 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/857538f273814e30bf74c0248d309754"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/857538f273814e30bf74c0248d309754"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/857538f273814e30bf74c0248d309754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_857538f273814e30bf74c0248d309754", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:49:19.754736 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Tenant: admin Sep 11 00:49:19.754736 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Tenant-Id: 857538f273814e30bf74c0248d309754 Sep 11 00:49:19.754736 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Tenant-Name: admin Sep 11 00:49:19.754736 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User: admin Sep 11 00:49:19.754736 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User-Domain-Id: default Sep 11 00:49:19.754736 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User-Domain-Name: Default Sep 11 00:49:19.754736 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User-Id: cf7ec619bcef4004bcdaf4a26a07260b Sep 11 00:49:19.754736 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User-Name: admin Sep 11 00:49:19.754736 dv-cinder-master-3-smb devstack@n-api.service[105507]: method: > Sep 11 00:49:19.754736 dv-cinder-master-3-smb devstack@n-api.service[105507]: exception: Flavor 84 could not be found. Sep 11 00:49:19.754736 dv-cinder-master-3-smb devstack@n-api.service[105507]: action_args: {'id': '84'} Sep 11 00:49:19.754736 dv-cinder-master-3-smb devstack@n-api.service[105507]: {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:49:19.754736 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:49:19.755573 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:19.756859 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-1bbcb005-21f2-4df5-abb7-fe7ce09d62a4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:49:19.758099 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-1bbcb005-21f2-4df5-abb7-fe7ce09d62a4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.421554 Sep 11 00:49:19.758099 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1190 bytes} [Sun Sep 11 00:49:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:19.764809 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-d5856dd7-fc13-435f-8c34-701905f3273d admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:19.779993 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-d5856dd7-fc13-435f-8c34-701905f3273d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018837 Sep 11 00:49:19.780549 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Sep 11 00:49:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:49:19.793453 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-47032fdd-92a5-4bbf-9319-1c263cf45942 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:19.810599 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-47032fdd-92a5-4bbf-9319-1c263cf45942 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.023785 Sep 11 00:49:19.811134 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Sep 11 00:49:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:49:19.820956 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-bb2f805a-8727-40dc-b720-01cf7762847d admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:19.829093 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.wsgi [None req-bb2f805a-8727-40dc-b720-01cf7762847d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-bb2f805a-8727-40dc-b720-01cf7762847d admin admin] Request method failure captured: Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: Accept: application/json Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: Accept-Encoding: gzip, deflate Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: Connection: keep-alive Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: Content-Length: 0 Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: Host: 10.222.0.23 Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: Openstack-Api-Version: compute 2.92 Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: Openstack-System-Scope: None Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: User-Agent: python-novaclient Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Auth-Token: gAAAAABjHTCPzIfUp8KX57g3ccvRdWtR9AeZZBWfzlw1sQFr4x0zd8cAQxkbswpp_rXFSOXU-ZgX7d9UsqF7OMekXrKp4sdzDns4McfPtsLR4Z0bmF4TCfsoRGei1FMscZqpHSoukQK0Wg7DRJQN89NTmQG_h2eJONfx4iIaWLMqUKnJwyieGC8 Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Domain-Id: None Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Domain-Name: None Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Identity-Status: Confirmed Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Is-Admin-Project: True Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Project-Domain-Id: default Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Project-Domain-Name: Default Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Project-Id: 857538f273814e30bf74c0248d309754 Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Project-Name: admin Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Role: member,admin,reader Sep 11 00:49:19.830659 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Roles: member,admin,reader Sep 11 00:49:19.832385 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/857538f273814e30bf74c0248d309754"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/857538f273814e30bf74c0248d309754"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/857538f273814e30bf74c0248d309754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_857538f273814e30bf74c0248d309754", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:49:19.832385 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Tenant: admin Sep 11 00:49:19.832385 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Tenant-Id: 857538f273814e30bf74c0248d309754 Sep 11 00:49:19.832385 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Tenant-Name: admin Sep 11 00:49:19.832385 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User: admin Sep 11 00:49:19.832385 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User-Domain-Id: default Sep 11 00:49:19.832385 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User-Domain-Name: Default Sep 11 00:49:19.832385 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User-Id: cf7ec619bcef4004bcdaf4a26a07260b Sep 11 00:49:19.832385 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User-Name: admin Sep 11 00:49:19.832385 dv-cinder-master-3-smb devstack@n-api.service[105508]: method: > Sep 11 00:49:19.832385 dv-cinder-master-3-smb devstack@n-api.service[105508]: exception: Flavor 84 could not be found. Sep 11 00:49:19.832385 dv-cinder-master-3-smb devstack@n-api.service[105508]: action_args: {'id': '84'} Sep 11 00:49:19.832385 dv-cinder-master-3-smb devstack@n-api.service[105508]: {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:49:19.832385 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:49:19.833549 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:19.834772 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-bb2f805a-8727-40dc-b720-01cf7762847d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:49:19.836029 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-bb2f805a-8727-40dc-b720-01cf7762847d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.014816 Sep 11 00:49:19.836029 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 24/47] 10.222.0.23 () {60 vars in 1190 bytes} [Sun Sep 11 00:49:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 11 00:49:21.073124 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-47032fdd-92a5-4bbf-9319-1c263cf45942 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:21.074661 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-47032fdd-92a5-4bbf-9319-1c263cf45942 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002245 Sep 11 00:49:21.075269 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 24/48] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Sep 11 00:49:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:49:21.618686 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-abec627a-4f48-4696-bcde-7056b6785f7d admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:21.625151 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.wsgi [None req-abec627a-4f48-4696-bcde-7056b6785f7d admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-abec627a-4f48-4696-bcde-7056b6785f7d admin admin] Request method failure captured: Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: Accept: application/json Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: Accept-Encoding: gzip, deflate Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: Connection: keep-alive Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: Content-Length: 0 Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: Host: 10.222.0.23 Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: Openstack-Api-Version: compute 2.92 Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: Openstack-System-Scope: None Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: User-Agent: python-novaclient Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Auth-Token: gAAAAABjHTCQVEx12ZJaOu_hfgJa89PHh11h-EZ8D2RTL4TbB3njLsjF579436t2JnQsu01cwKusntrrVTY3bv-fa7c8EFvUDWSzvG2BmojT6RkGO017QYMvFLTL8CuiM_qhIzRzk2hN31jr2c-KdlNtVlCIRNxARzsuj0rciN-7N5LbUdpqAg8 Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Domain-Id: None Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Domain-Name: None Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Identity-Status: Confirmed Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Is-Admin-Project: True Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Project-Domain-Id: default Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Project-Domain-Name: Default Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Project-Id: 857538f273814e30bf74c0248d309754 Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Project-Name: admin Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Role: member,admin,reader Sep 11 00:49:21.626658 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Roles: member,admin,reader Sep 11 00:49:21.628120 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/857538f273814e30bf74c0248d309754"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/857538f273814e30bf74c0248d309754"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/857538f273814e30bf74c0248d309754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_857538f273814e30bf74c0248d309754", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:49:21.628120 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Tenant: admin Sep 11 00:49:21.628120 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Tenant-Id: 857538f273814e30bf74c0248d309754 Sep 11 00:49:21.628120 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-Tenant-Name: admin Sep 11 00:49:21.628120 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User: admin Sep 11 00:49:21.628120 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User-Domain-Id: default Sep 11 00:49:21.628120 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User-Domain-Name: Default Sep 11 00:49:21.628120 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User-Id: cf7ec619bcef4004bcdaf4a26a07260b Sep 11 00:49:21.628120 dv-cinder-master-3-smb devstack@n-api.service[105508]: X-User-Name: admin Sep 11 00:49:21.628120 dv-cinder-master-3-smb devstack@n-api.service[105508]: method: > Sep 11 00:49:21.628120 dv-cinder-master-3-smb devstack@n-api.service[105508]: exception: Flavor 451 could not be found. Sep 11 00:49:21.628120 dv-cinder-master-3-smb devstack@n-api.service[105508]: action_args: {'id': '451'} Sep 11 00:49:21.628120 dv-cinder-master-3-smb devstack@n-api.service[105508]: {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:49:21.628120 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:49:21.628912 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Sep 11 00:49:21.630083 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-abec627a-4f48-4696-bcde-7056b6785f7d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:49:21.631413 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-abec627a-4f48-4696-bcde-7056b6785f7d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.415519 Sep 11 00:49:21.631413 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 25/49] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Sep 11 00:49:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:21.638500 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-0f7dedb9-77ee-41e8-a3c8-2b84c417aad2 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:21.653636 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-0f7dedb9-77ee-41e8-a3c8-2b84c417aad2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018854 Sep 11 00:49:21.654183 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Sep 11 00:49:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:49:21.664033 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-1dd693e2-822c-48bb-8096-a71c8646b01e admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:21.679698 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-1dd693e2-822c-48bb-8096-a71c8646b01e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019271 Sep 11 00:49:21.680218 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 26/51] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Sep 11 00:49:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:49:21.689511 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-d6a4f48f-6cfe-4a54-9239-81540157565f admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:21.694981 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.wsgi [None req-d6a4f48f-6cfe-4a54-9239-81540157565f admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-d6a4f48f-6cfe-4a54-9239-81540157565f admin admin] Request method failure captured: Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: Accept: application/json Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: Accept-Encoding: gzip, deflate Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: Connection: keep-alive Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: Content-Length: 0 Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: Host: 10.222.0.23 Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: Openstack-Api-Version: compute 2.92 Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: Openstack-System-Scope: None Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: User-Agent: python-novaclient Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Auth-Token: gAAAAABjHTCQVEx12ZJaOu_hfgJa89PHh11h-EZ8D2RTL4TbB3njLsjF579436t2JnQsu01cwKusntrrVTY3bv-fa7c8EFvUDWSzvG2BmojT6RkGO017QYMvFLTL8CuiM_qhIzRzk2hN31jr2c-KdlNtVlCIRNxARzsuj0rciN-7N5LbUdpqAg8 Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Domain-Id: None Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Domain-Name: None Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Identity-Status: Confirmed Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Is-Admin-Project: True Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Project-Domain-Id: default Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Project-Domain-Name: Default Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Project-Id: 857538f273814e30bf74c0248d309754 Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Project-Name: admin Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Role: member,admin,reader Sep 11 00:49:21.696527 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Roles: member,admin,reader Sep 11 00:49:21.698124 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/857538f273814e30bf74c0248d309754"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/857538f273814e30bf74c0248d309754"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/857538f273814e30bf74c0248d309754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_857538f273814e30bf74c0248d309754", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:49:21.698124 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Tenant: admin Sep 11 00:49:21.698124 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Tenant-Id: 857538f273814e30bf74c0248d309754 Sep 11 00:49:21.698124 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-Tenant-Name: admin Sep 11 00:49:21.698124 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User: admin Sep 11 00:49:21.698124 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User-Domain-Id: default Sep 11 00:49:21.698124 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User-Domain-Name: Default Sep 11 00:49:21.698124 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User-Id: cf7ec619bcef4004bcdaf4a26a07260b Sep 11 00:49:21.698124 dv-cinder-master-3-smb devstack@n-api.service[105507]: X-User-Name: admin Sep 11 00:49:21.698124 dv-cinder-master-3-smb devstack@n-api.service[105507]: method: > Sep 11 00:49:21.698124 dv-cinder-master-3-smb devstack@n-api.service[105507]: exception: Flavor 451 could not be found. Sep 11 00:49:21.698124 dv-cinder-master-3-smb devstack@n-api.service[105507]: action_args: {'id': '451'} Sep 11 00:49:21.698124 dv-cinder-master-3-smb devstack@n-api.service[105507]: {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:49:21.698124 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:49:21.699082 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Sep 11 00:49:21.700257 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-d6a4f48f-6cfe-4a54-9239-81540157565f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:49:21.701311 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-d6a4f48f-6cfe-4a54-9239-81540157565f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011883 Sep 11 00:49:21.701311 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 26/52] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Sep 11 00:49:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:22.961638 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-1dd693e2-822c-48bb-8096-a71c8646b01e admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:22.962657 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-1dd693e2-822c-48bb-8096-a71c8646b01e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 11 00:49:22.963087 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Sep 11 00:49:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:49:23.526180 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-b62e4835-70bb-43ba-8624-1e472f5c184d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:49:23.549539 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-b62e4835-70bb-43ba-8624-1e472f5c184d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.450291 Sep 11 00:49:23.550067 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 27/54] 10.222.0.23 () {64 vars in 1235 bytes} [Sun Sep 11 00:49:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 00:49:24.798673 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-1dd693e2-822c-48bb-8096-a71c8646b01e admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:24.799806 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-1dd693e2-822c-48bb-8096-a71c8646b01e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Sep 11 00:49:24.800172 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Sep 11 00:49:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:49:25.357627 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-536f95a9-7443-4327-916e-264369cd1247 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:49:25.378495 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-536f95a9-7443-4327-916e-264369cd1247 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.441480 Sep 11 00:49:25.379005 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 28/56] 10.222.0.23 () {64 vars in 1235 bytes} [Sun Sep 11 00:49:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:49:26.625737 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-1dd693e2-822c-48bb-8096-a71c8646b01e admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:26.626739 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-1dd693e2-822c-48bb-8096-a71c8646b01e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 11 00:49:26.627127 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 29/57] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Sep 11 00:49:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:49:27.184125 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-be811e2d-c323-4929-9607-4f3bbefe1c90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:49:27.205890 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-be811e2d-c323-4929-9607-4f3bbefe1c90 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.443112 Sep 11 00:49:27.206432 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 29/58] 10.222.0.23 () {64 vars in 1235 bytes} [Sun Sep 11 00:49:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:49:28.421540 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-1dd693e2-822c-48bb-8096-a71c8646b01e admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:28.422558 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-1dd693e2-822c-48bb-8096-a71c8646b01e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 11 00:49:28.422930 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 30/59] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Sep 11 00:49:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:49:28.978399 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-ff855236-bb21-4d47-a7da-08a417b9c999 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:49:29.006378 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-ff855236-bb21-4d47-a7da-08a417b9c999 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.446716 Sep 11 00:49:29.006918 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 30/60] 10.222.0.23 () {64 vars in 1235 bytes} [Sun Sep 11 00:49:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:49:30.243124 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-1dd693e2-822c-48bb-8096-a71c8646b01e admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:30.244148 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-1dd693e2-822c-48bb-8096-a71c8646b01e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 11 00:49:30.244538 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 31/61] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Sep 11 00:49:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:49:30.828276 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-0507f1cd-c5bc-4a88-9afa-c013ff416a46 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:49:30.849718 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-0507f1cd-c5bc-4a88-9afa-c013ff416a46 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.469784 Sep 11 00:49:30.850239 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 31/62] 10.222.0.23 () {60 vars in 1202 bytes} [Sun Sep 11 00:49:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:50:27.890240 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-1dd693e2-822c-48bb-8096-a71c8646b01e admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:50:27.891288 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-1dd693e2-822c-48bb-8096-a71c8646b01e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 11 00:50:27.891682 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 32/63] 10.222.0.23 () {54 vars in 931 bytes} [Sun Sep 11 00:50:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:50:27.905781 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:28.323307 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-377944ad-c048-482a-8e1f-75d2cc6cbbc1 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:50:28.343556 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-377944ad-c048-482a-8e1f-75d2cc6cbbc1 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.445275 Sep 11 00:50:28.344091 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 32/64] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Sep 11 00:50:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:50:28.366485 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_api:SELECT=14 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:28.371739 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-8290eb71-ecc0-40e5-a443-8265fa217e2d admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:50:28.381920 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-8290eb71-ecc0-40e5-a443-8265fa217e2d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017615 Sep 11 00:50:28.382451 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 33/65] 10.222.0.23 () {60 vars in 1283 bytes} [Sun Sep 11 00:50:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:50:28.394398 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-48a0c85b-31bc-4661-9244-c65293bbcd06 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:50:28.402002 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-48a0c85b-31bc-4661-9244-c65293bbcd06 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011238 Sep 11 00:50:28.402506 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 33/66] 10.222.0.23 () {60 vars in 1286 bytes} [Sun Sep 11 00:50:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:50:28.413874 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-0341d77f-a277-40fe-b983-9baadd1c73e9 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:50:28.421484 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-0341d77f-a277-40fe-b983-9baadd1c73e9 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011223 Sep 11 00:50:28.422001 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 34/67] 10.222.0.23 () {60 vars in 1286 bytes} [Sun Sep 11 00:50:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:50:28.434185 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-409c79d3-4d8b-4ca0-af0b-465198dcd311 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:50:28.441491 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-409c79d3-4d8b-4ca0-af0b-465198dcd311 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011041 Sep 11 00:50:28.441996 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 34/68] 10.222.0.23 () {60 vars in 1283 bytes} [Sun Sep 11 00:50:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:53:36.666524 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-0341d77f-a277-40fe-b983-9baadd1c73e9 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:53:36.667576 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-0341d77f-a277-40fe-b983-9baadd1c73e9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 11 00:53:36.667940 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Sep 11 00:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:53:36.808000 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_api:SELECT=6 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:36.990695 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-f7f7cba9-02fc-4e7c-ab6a-f2d30bab9d02 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:53:36.995739 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-f7f7cba9-02fc-4e7c-ab6a-f2d30bab9d02 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:53:36.996212 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-f7f7cba9-02fc-4e7c-ab6a-f2d30bab9d02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:53:36.996638 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-f7f7cba9-02fc-4e7c-ab6a-f2d30bab9d02 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:53:36.997343 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-f7f7cba9-02fc-4e7c-ab6a-f2d30bab9d02 admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:53:36.997784 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-f7f7cba9-02fc-4e7c-ab6a-f2d30bab9d02 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:53:36.998197 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-f7f7cba9-02fc-4e7c-ab6a-f2d30bab9d02 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:53:37.029765 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-f7f7cba9-02fc-4e7c-ab6a-f2d30bab9d02 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.224170 Sep 11 00:53:37.030302 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 35/70] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Sep 11 00:53:36 2022] GET /compute/v2.1/os-services => generated 785 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:53:38.126486 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-0341d77f-a277-40fe-b983-9baadd1c73e9 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:53:38.127637 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-0341d77f-a277-40fe-b983-9baadd1c73e9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001684 Sep 11 00:53:38.128116 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Sep 11 00:53:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:53:38.332959 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-47a9b838-47c0-4433-acf0-6c0aa6bebc36 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:53:38.336944 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-47a9b838-47c0-4433-acf0-6c0aa6bebc36 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:53:38.337425 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-47a9b838-47c0-4433-acf0-6c0aa6bebc36 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:53:38.337853 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-47a9b838-47c0-4433-acf0-6c0aa6bebc36 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:53:38.338560 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-47a9b838-47c0-4433-acf0-6c0aa6bebc36 admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:53:38.339003 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-47a9b838-47c0-4433-acf0-6c0aa6bebc36 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:53:38.339449 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-47a9b838-47c0-4433-acf0-6c0aa6bebc36 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:53:38.361767 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-47a9b838-47c0-4433-acf0-6c0aa6bebc36 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.093702 Sep 11 00:53:38.362325 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 36/72] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Sep 11 00:53:38 2022] GET /compute/v2.1/os-services => generated 785 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:53:49.876638 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-0341d77f-a277-40fe-b983-9baadd1c73e9 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:53:49.878269 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-0341d77f-a277-40fe-b983-9baadd1c73e9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 Sep 11 00:53:49.878661 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 37/73] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Sep 11 00:53:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:53:50.020366 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_cell0:SELECT=4 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:50.021061 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_cell1:SELECT=4 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:50.021695 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_api:SELECT=8 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:50.072786 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-2a07f7d3-59ce-489d-84f6-3b7382ff3840 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:53:50.076242 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-2a07f7d3-59ce-489d-84f6-3b7382ff3840 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:53:50.076706 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-2a07f7d3-59ce-489d-84f6-3b7382ff3840 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:53:50.077148 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-2a07f7d3-59ce-489d-84f6-3b7382ff3840 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:53:50.077849 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-2a07f7d3-59ce-489d-84f6-3b7382ff3840 admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:53:50.078289 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-2a07f7d3-59ce-489d-84f6-3b7382ff3840 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:53:50.078704 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-2a07f7d3-59ce-489d-84f6-3b7382ff3840 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:53:50.103477 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-2a07f7d3-59ce-489d-84f6-3b7382ff3840 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.087516 Sep 11 00:53:50.104017 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 37/74] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Sep 11 00:53:50 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:53:51.173146 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-0341d77f-a277-40fe-b983-9baadd1c73e9 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:53:51.174157 dv-cinder-master-3-smb devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-0341d77f-a277-40fe-b983-9baadd1c73e9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001818 Sep 11 00:53:51.174552 dv-cinder-master-3-smb devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 38/75] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Sep 11 00:53:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:53:51.372543 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-d462c038-0e38-47cd-82ee-3995169d906b admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:53:51.375967 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-d462c038-0e38-47cd-82ee-3995169d906b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:53:51.376442 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-d462c038-0e38-47cd-82ee-3995169d906b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:53:51.376870 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-d462c038-0e38-47cd-82ee-3995169d906b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:53:51.377568 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-d462c038-0e38-47cd-82ee-3995169d906b admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:53:51.378090 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-d462c038-0e38-47cd-82ee-3995169d906b admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:53:51.378509 dv-cinder-master-3-smb devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-d462c038-0e38-47cd-82ee-3995169d906b admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:53:51.399907 dv-cinder-master-3-smb devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-d462c038-0e38-47cd-82ee-3995169d906b admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.088424 Sep 11 00:53:51.400449 dv-cinder-master-3-smb devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 38/76] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Sep 11 00:53:51 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:54:52.502257 dv-cinder-master-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Sep 11 00:54:52.502834 dv-cinder-master-3-smb devstack@n-api.service[105506]: Sun Sep 11 00:54:52 2022 - graceful shutdown triggered... Sep 11 00:54:52.503329 dv-cinder-master-3-smb devstack@n-api.service[105508]: Gracefully killing worker 2 (pid: 105508)... Sep 11 00:54:52.503704 dv-cinder-master-3-smb devstack@n-api.service[105507]: Gracefully killing worker 1 (pid: 105507)... Sep 11 00:54:52.633511 dv-cinder-master-3-smb devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_api:SELECT=4 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:53.504053 dv-cinder-master-3-smb devstack@n-api.service[105506]: worker 1 buried after 1 seconds Sep 11 00:54:53.504053 dv-cinder-master-3-smb devstack@n-api.service[105506]: worker 2 buried after 1 seconds Sep 11 00:54:53.504053 dv-cinder-master-3-smb devstack@n-api.service[105506]: goodbye to uWSGI. Sep 11 00:54:53.506462 dv-cinder-master-3-smb systemd[1]: devstack@n-api.service: Succeeded. Sep 11 00:54:53.507566 dv-cinder-master-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Sep 11 00:54:53.512149 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Sep 11 00:54:53.523835 dv-cinder-master-3-smb devstack@n-api.service[120478]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 11 00:54:53.526415 dv-cinder-master-3-smb devstack@n-api.service[120478]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 00:54:53 2022] *** Sep 11 00:54:53.526578 dv-cinder-master-3-smb devstack@n-api.service[120478]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 00:54:53.526708 dv-cinder-master-3-smb devstack@n-api.service[120478]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 00:54:53.526826 dv-cinder-master-3-smb devstack@n-api.service[120478]: nodename: dv-cinder-master-3-smb Sep 11 00:54:53.526941 dv-cinder-master-3-smb devstack@n-api.service[120478]: machine: x86_64 Sep 11 00:54:53.527049 dv-cinder-master-3-smb devstack@n-api.service[120478]: clock source: unix Sep 11 00:54:53.527311 dv-cinder-master-3-smb devstack@n-api.service[120478]: pcre jit disabled Sep 11 00:54:53.527431 dv-cinder-master-3-smb devstack@n-api.service[120478]: detected number of CPU cores: 4 Sep 11 00:54:53.527556 dv-cinder-master-3-smb devstack@n-api.service[120478]: current working directory: / Sep 11 00:54:53.527672 dv-cinder-master-3-smb devstack@n-api.service[120478]: detected binary path: /usr/bin/uwsgi-core Sep 11 00:54:53.527818 dv-cinder-master-3-smb devstack@n-api.service[120478]: your processes number limit is 47680 Sep 11 00:54:53.527940 dv-cinder-master-3-smb devstack@n-api.service[120478]: your memory page size is 4096 bytes Sep 11 00:54:53.528050 dv-cinder-master-3-smb devstack@n-api.service[120478]: detected max file descriptor number: 2048 Sep 11 00:54:53.528158 dv-cinder-master-3-smb devstack@n-api.service[120478]: lock engine: pthread robust mutexes Sep 11 00:54:53.528443 dv-cinder-master-3-smb devstack@n-api.service[120478]: thunder lock: enabled Sep 11 00:54:53.528751 dv-cinder-master-3-smb devstack@n-api.service[120478]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 11 00:54:53.528955 dv-cinder-master-3-smb devstack@n-api.service[120478]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 00:54:53.569147 dv-cinder-master-3-smb devstack@n-api.service[120478]: Python main interpreter initialized at 0x561b6a7619c0 Sep 11 00:54:53.569147 dv-cinder-master-3-smb devstack@n-api.service[120478]: python threads support enabled Sep 11 00:54:53.569147 dv-cinder-master-3-smb devstack@n-api.service[120478]: your server socket listen backlog is limited to 100 connections Sep 11 00:54:53.569147 dv-cinder-master-3-smb devstack@n-api.service[120478]: your mercy for graceful operations on workers is 90 seconds Sep 11 00:54:53.569601 dv-cinder-master-3-smb devstack@n-api.service[120478]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 00:54:53.569601 dv-cinder-master-3-smb devstack@n-api.service[120478]: *** Operational MODE: preforking *** Sep 11 00:54:53.569881 dv-cinder-master-3-smb devstack@n-api.service[120478]: *** uWSGI is running in multiple interpreter mode *** Sep 11 00:54:53.569881 dv-cinder-master-3-smb devstack@n-api.service[120478]: spawned uWSGI master process (pid: 120478) Sep 11 00:54:53.570102 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Sep 11 00:54:53.570647 dv-cinder-master-3-smb devstack@n-api.service[120478]: spawned uWSGI worker 1 (pid: 120496, cores: 1) Sep 11 00:54:53.571222 dv-cinder-master-3-smb devstack@n-api.service[120478]: spawned uWSGI worker 2 (pid: 120497, cores: 1) Sep 11 00:54:53.571532 dv-cinder-master-3-smb devstack@n-api.service[120478]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 00:54:54.233238 dv-cinder-master-3-smb devstack@n-api.service[120496]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 00:54:54.248008 dv-cinder-master-3-smb devstack@n-api.service[120497]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 00:54:55.374244 dv-cinder-master-3-smb devstack@n-api.service[120496]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:54:55.374244 dv-cinder-master-3-smb devstack@n-api.service[120496]: from cryptography.utils import int_from_bytes Sep 11 00:54:55.374877 dv-cinder-master-3-smb devstack@n-api.service[120496]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:54:55.374877 dv-cinder-master-3-smb devstack@n-api.service[120496]: from cryptography.utils import int_from_bytes Sep 11 00:54:55.402008 dv-cinder-master-3-smb devstack@n-api.service[120497]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:54:55.402008 dv-cinder-master-3-smb devstack@n-api.service[120497]: from cryptography.utils import int_from_bytes Sep 11 00:54:55.402585 dv-cinder-master-3-smb devstack@n-api.service[120497]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:54:55.402585 dv-cinder-master-3-smb devstack@n-api.service[120497]: from cryptography.utils import int_from_bytes Sep 11 00:54:57.744912 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 00:54:57.745561 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 00:54:57.745846 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 00:54:57.746083 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 00:54:57.746341 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 00:54:57.746771 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.747085 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.747651 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.747777 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.748066 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.748380 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.748756 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.749027 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.749361 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.749623 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.749941 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.750451 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.750781 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.751096 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.751445 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.751774 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.752152 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.752418 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.752793 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.753459 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.754899 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.755258 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.755570 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.756214 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.756462 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.756783 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.757131 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.757533 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.757775 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.758114 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.758489 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.758813 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.759120 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.759494 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.759899 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.760234 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.760544 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.760853 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.761191 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.761518 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.761828 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.762168 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.762501 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.762815 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.763115 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.763500 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.763821 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.764125 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.764434 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.764746 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.765000 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.765307 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.765635 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.765962 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.766291 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.766544 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.766795 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.767118 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.767486 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.767800 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.768110 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.768504 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.768809 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.769129 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.769424 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.769732 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.770038 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.770368 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.770687 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.771013 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.771366 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.771693 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.772124 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.772370 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.772678 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.773029 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.773348 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.773655 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.773976 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.774298 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.774606 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.774914 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.775242 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.775565 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.775907 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.776210 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.776461 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.776763 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.777066 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.777387 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.777711 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.778002 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.778308 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.778606 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.778910 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.779255 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.779562 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.779866 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.780177 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.780479 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.780786 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.781092 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.781395 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.781702 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.782047 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.782361 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.782669 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.782980 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.783312 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.784448 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.784448 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.784448 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.784689 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.784926 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.785174 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.785484 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.785805 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.786114 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.786423 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.786744 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.787048 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.787389 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.787710 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.788017 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.788325 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.788626 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.788928 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.789232 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.789536 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.789839 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.790196 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.790441 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.790762 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.791084 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.791432 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.791741 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.792058 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.792391 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.792724 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.793065 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.793414 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.793732 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.794072 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.794435 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.794724 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.795038 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.795385 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.795715 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.796031 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.796706 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.797030 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.797489 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.797815 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.798152 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.798478 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.799059 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.799195 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.799474 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.799828 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.800161 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.800490 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.800802 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.801150 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.801504 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.801836 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.802166 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.802493 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.802809 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.803124 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.803464 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.803813 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.804129 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.804442 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.804763 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.805077 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.805404 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.805722 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.806037 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.806348 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.806662 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.806972 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.807347 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.807668 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.807994 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.808321 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.808633 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.808950 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.809262 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.809581 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.809892 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.810197 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.810504 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.810811 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.811121 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.811468 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.811810 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.812170 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.812451 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.812791 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.813110 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.813414 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.813725 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.814035 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.814342 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.814653 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.814965 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.815332 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.815662 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.815975 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.816284 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.816608 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.816914 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.817222 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.817540 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.817857 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.818160 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.818472 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.818782 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.819105 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.819471 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.819783 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.820121 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.820470 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.820760 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.821087 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.821416 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.822533 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.822856 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.823169 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.823504 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.823816 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.824126 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.824438 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.824745 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.825061 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.825364 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.825665 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.825971 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.826296 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.826604 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.826911 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.827338 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.827547 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.827946 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.828215 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.828550 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.828890 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.829237 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.829540 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.829858 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.830177 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.830489 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.830857 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.831194 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.831510 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.831840 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.832156 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.832482 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.832794 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.832894 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 00:54:57.833320 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.833417 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 00:54:57.833503 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.833698 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 00:54:57.833846 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.834013 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.834328 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.834466 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 00:54:57.834595 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 00:54:57.834691 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.834996 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.835104 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.835349 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.835466 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.835658 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.835757 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.835973 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.836133 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.836288 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.836428 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.836575 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.836733 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.836881 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.837018 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.837161 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.837295 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.837472 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.837632 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.837770 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.837916 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.838057 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.838223 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.838391 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.838528 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.838703 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.838844 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.839011 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.839148 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.839364 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.839510 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.839656 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.839793 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.839929 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.840064 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.840244 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.840387 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.840573 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.840721 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.840909 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.841059 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.841229 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.841380 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.841517 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.841656 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.841828 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.841977 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.842126 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.842266 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.842439 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.842587 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.842750 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.842901 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.843048 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.843205 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.843377 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.843524 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.843689 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.843830 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.844033 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.844191 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.844327 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.844463 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.844602 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.844756 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.844909 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.845048 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.845203 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.845350 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.845498 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.845718 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.845868 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.846028 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.846183 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.846327 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.846505 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.846665 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.846806 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.846985 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.847129 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.847373 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.847529 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.847679 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.847817 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.847955 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.848100 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.848240 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.848389 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.848536 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.848679 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.848825 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.848972 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.849119 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.849275 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.849417 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.849562 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.849701 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.849850 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.849995 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.850129 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.850275 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.850421 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.850560 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.850709 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.850863 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.851010 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.851155 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.851320 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.851458 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.851602 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.851748 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.851898 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.852035 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.852184 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.852321 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.852473 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.852619 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.852771 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.852919 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.853057 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.853208 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.853355 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.853502 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.853649 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.853803 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.853941 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.854093 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.854230 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.854378 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.854528 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.854678 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.854814 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.854959 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.855098 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.855202 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.855439 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.855585 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.855752 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.855905 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.856070 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.856170 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.856363 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.856484 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.856685 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.857125 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.857269 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.857553 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.857648 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.857776 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.857904 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.858081 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.858223 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.858423 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.858568 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.858741 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.858887 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.859048 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.859281 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.859390 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.859568 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.859694 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.859881 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.860000 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.861053 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.861165 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.861244 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.861336 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.861431 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.861517 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.861517 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.861691 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.861691 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.861845 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.861928 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.862066 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.862165 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.862264 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.862363 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.862457 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.862659 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.862761 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.862961 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.863068 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.863297 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.863448 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.863616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.863770 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.863928 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.864039 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.864207 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.864469 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.864548 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.864628 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.864814 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.864926 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.865095 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.865264 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.865413 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.865557 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.865714 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.865864 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.866022 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.866168 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.866309 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.866447 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.866601 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.866748 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.866899 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.867044 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.867231 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.867386 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.867528 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.867772 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.867922 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.868068 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.868208 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.868362 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.868510 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.868659 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.868821 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.868960 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.869105 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.869243 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.869398 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.869532 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.869687 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.869835 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.869972 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.870110 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.870248 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.870385 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.870585 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.870752 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.870892 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.871030 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.871188 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.871326 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.871476 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.871625 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.871771 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.871873 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.871958 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.872144 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.872239 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.872458 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.872553 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.872761 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.872869 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.873062 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.873155 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.873361 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.873452 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.873662 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.873761 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.873962 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.874071 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.874271 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.874371 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.874566 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.874663 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.874867 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.874968 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.875161 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.875363 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.875577 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.875696 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.875783 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.875875 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.876092 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.876192 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.876392 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.876497 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.876692 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.876785 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.876992 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.877082 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:54:57.877303 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.877405 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.877656 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.877914 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.878013 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.878100 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.878258 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.878360 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.878570 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.878672 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.878875 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.878966 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.879196 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.879292 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.879508 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.879600 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.879812 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.879903 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.880118 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.880213 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.880428 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.880518 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.880743 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.880835 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.881053 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.881154 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.881358 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.881457 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.881666 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.881767 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.881971 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.882071 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.882276 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.882375 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.882581 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.882681 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.882887 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.882979 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.883211 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.883305 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.883521 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.883625 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.883825 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.883925 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.884130 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.884230 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.884433 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.884538 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.884755 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.884854 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.885064 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.885156 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.885370 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.885472 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.885679 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.885805 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.885981 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.886085 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.886305 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.886406 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.886615 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.886736 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.886924 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.887030 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.887284 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.887391 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.887597 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.887700 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.887915 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.888064 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.888221 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.888337 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.888525 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.888617 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.888839 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.888929 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.889145 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.889234 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.889450 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.889536 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.889758 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.889864 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.890069 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.890160 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.890373 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.890475 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.895214 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.895364 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.895480 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.895585 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.895679 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.895770 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.895858 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.895961 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.896058 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.896154 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.896241 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.896330 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.896330 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.896488 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.896574 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.896665 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.896757 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.896832 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.896918 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.897002 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.897082 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.897179 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.897272 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.897356 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.897451 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.897601 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.897696 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.897771 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.897850 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.897943 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.898042 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.898042 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.898042 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.898042 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.898042 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.898042 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.898042 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.898042 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.898637 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.898637 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.898637 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.898637 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.898935 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.899120 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.899306 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.899466 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.899577 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.899829 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.899940 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.900070 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.900170 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.900392 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.900493 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.900700 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.900791 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.901009 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.901195 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.901301 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.901453 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.901596 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.901740 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.901964 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.902205 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.902409 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.902639 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.902901 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.903130 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.903256 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.903355 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.903457 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.903627 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.903712 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.903793 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.903939 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.904037 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.904131 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.904328 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.904459 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.904641 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.904790 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.905069 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.905175 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.905263 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.905386 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.905567 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.905695 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.905892 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.905995 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.906205 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.906310 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.906573 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.906664 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.906876 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.906997 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.907272 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.907391 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.907568 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.907808 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.907958 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.908119 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.908258 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.908360 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.908437 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.908508 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.908743 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.908912 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.909073 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.909210 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.909390 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.909472 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.909695 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.909788 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.910024 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.910105 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.910331 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.910414 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.910940 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.911043 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.911043 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.911342 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.911429 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.911510 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.911697 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.911803 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.911995 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.912100 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.912323 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.912427 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.912637 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.912719 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.912947 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.913029 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.913375 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.913475 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.913563 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.913648 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.913867 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.913960 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.914187 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.914300 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.914498 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.914581 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.914820 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.914903 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.915128 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.915269 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.915470 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.915585 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.915778 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.915905 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.916092 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.916215 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.916432 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.916545 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.916767 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.916857 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.917082 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.917172 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.917442 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.917545 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.917714 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.918411 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.918542 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.918647 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.918741 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.918840 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.918929 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.919024 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.919127 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.919248 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.919351 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.919495 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.919648 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.919813 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.919923 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.920109 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.920201 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.920416 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.920518 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.920726 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.920827 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.921031 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.921503 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.921698 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.921843 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.922000 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.922103 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.922311 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.922413 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.922623 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.925543 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.925663 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.925743 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.925824 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.925910 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.925999 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.926084 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.926179 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.926273 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.926273 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.926442 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.926533 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.926632 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.926714 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.926805 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.926886 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.926979 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.927060 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.927154 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.927325 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.927424 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.927551 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.927638 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.927719 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.927821 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.927904 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.927985 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.928072 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.928152 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.928233 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.928319 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.928393 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.928464 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.928542 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.928621 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.928707 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.928787 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.928867 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.928942 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.929021 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.929101 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.929183 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.929264 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.929337 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.929503 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.929721 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.929818 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.929988 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.930127 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.930294 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.930429 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.930612 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.930765 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.930882 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.930972 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.931217 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.931423 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.931530 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.931721 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.931894 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.931996 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.932185 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.932288 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.932492 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.932642 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.932815 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.932952 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.933088 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.933223 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.933358 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.933507 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.933650 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.933920 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.934117 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.934301 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.934509 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.934714 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.934847 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.934938 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.935012 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.935083 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.935168 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.935275 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.935400 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.935483 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.935726 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.935821 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.936033 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.936118 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.936340 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.936422 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.936646 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.936728 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.936967 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.937074 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.937278 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.937407 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.937585 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.937949 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.938070 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.938148 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.938220 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.938296 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.938470 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.938563 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.938784 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.938866 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.939109 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.939452 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.939766 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.940101 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.940429 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.940540 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.940749 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.940853 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.941181 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.941298 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.941617 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.941804 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.941938 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.942044 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.942174 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.942278 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.942513 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.942618 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.942835 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.942935 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.943149 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.943303 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.943482 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.943586 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.943868 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.943979 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.944096 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.944187 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.944401 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.944501 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.944714 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.944822 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.945020 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.945121 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.945328 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.945436 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.945640 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.945741 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.945952 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.946046 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.946258 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.946397 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.946562 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.946656 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.946865 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.946965 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.947172 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.947300 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.947507 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.947609 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.947817 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.948002 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.948165 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.948315 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.948476 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.948620 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.948781 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.948930 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.949080 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.949230 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.949371 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.949519 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.949667 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.949923 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.950077 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.950221 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.950371 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.950475 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.950668 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.950819 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.950819 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.951088 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.951224 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.951317 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.951485 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.951612 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.951805 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.951923 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.952118 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.952277 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.952423 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.952598 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.952757 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.952912 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.953062 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.953210 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.953357 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.953548 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.953694 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.953873 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.954022 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.954176 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.954313 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.954467 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.954615 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.954763 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.954912 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.955052 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.955248 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.955410 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.955505 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.955734 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.956006 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.956106 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.956282 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.956414 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.956595 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.956732 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.956910 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.957041 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.957224 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.957342 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.957532 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.957634 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.957859 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.957978 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.958220 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.958321 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.958466 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.958571 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.958788 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.958887 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.959100 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.959215 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.959441 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.959664 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.959759 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.960027 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.960190 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.960370 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.960536 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.960737 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.960843 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.960938 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.961027 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.961219 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.961316 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.961546 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.961721 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.962334 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.962467 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.963345 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.963532 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.963685 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.963844 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.963999 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.964152 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.964295 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.964446 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.964596 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.964745 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.964895 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.965039 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.965180 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.965330 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.965480 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.965622 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.965783 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.965932 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.966031 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.966129 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.966217 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.966301 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.966395 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.966481 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.966575 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.966662 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.966754 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.966850 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.966937 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.967029 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.967126 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.967230 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.967329 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.967404 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.967475 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.967545 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.967625 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.967698 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.967778 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.967936 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.968029 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.968265 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.968377 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.968547 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.968639 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.968881 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.968970 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.969229 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.969312 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.969536 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.969617 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.969892 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.969972 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.970199 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.970301 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.970498 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.970588 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.970819 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.970911 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.971122 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.971240 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.971485 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.971581 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.971795 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.971884 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.972099 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.972182 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.972416 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.972509 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.972722 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.972804 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.973089 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.973191 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.973333 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.973424 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.973634 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.973725 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.973955 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.974227 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.974309 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.974558 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.974638 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.974878 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.974960 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.976201 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.976342 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.976466 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.976578 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.976715 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.976827 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.976937 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.977045 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.977154 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.977272 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.977393 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.977504 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.977687 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.977820 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.977951 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.978081 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.978201 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.978483 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.978602 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.978716 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.978826 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.978945 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.979059 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.979168 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.979339 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.979461 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.979574 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.979697 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.979697 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.979915 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.980025 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.980135 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.980270 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.980456 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.980570 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.980680 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.980810 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.980997 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.981138 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.981261 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.981372 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.981507 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.981705 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.981822 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.981822 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.982048 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.982177 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.982295 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.982516 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.982650 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.982773 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.983000 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.983324 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.983459 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.983572 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.983697 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.983809 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.983921 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.984039 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.984221 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.984350 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.984535 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.984661 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.984849 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.984976 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.985153 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.985279 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.985578 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.985705 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.985940 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.986076 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.986190 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.986315 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.986486 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.986612 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.986789 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.986907 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.987144 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.987400 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.987524 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.987643 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.987786 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.987913 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.988092 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.988226 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.988529 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.988659 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.988780 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.988899 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.989011 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.989205 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.989321 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.989440 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.989592 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.989709 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.989981 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.990098 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.990290 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.990431 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.990620 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.990741 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.990895 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.991026 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.991239 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.991374 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.991542 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.991668 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.991898 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.992017 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.992127 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.992246 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.992435 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.992586 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.992766 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.992889 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.993041 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.993168 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.993437 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.993574 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.993696 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.993814 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.993929 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.994047 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.994188 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.994322 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.994492 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.994612 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.994795 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.994959 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.995090 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.995275 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.995526 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.995645 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.995756 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.995885 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.996037 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.996253 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.996379 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.996558 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.996678 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.996857 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.996989 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.997164 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.997284 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.997466 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.997597 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.997798 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.997926 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.998100 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.998216 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.998405 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.998550 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.998814 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.998944 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.999064 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.999207 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.999338 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.999460 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.999630 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.999749 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:57.999936 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.000055 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.000246 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.000371 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.000556 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.000758 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.000879 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.001001 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.001155 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.001361 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.001487 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.001599 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.001767 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.001904 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.002100 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.002225 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.002378 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.002505 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.002714 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.002921 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.003039 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.003262 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.003524 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.003654 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.003654 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.003881 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.003994 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.004119 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.004271 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.004398 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.004577 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.004703 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.004912 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.005050 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.005165 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.005275 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.005504 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.005630 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.005812 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.005938 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.006132 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.006268 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.006464 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.006586 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.006723 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.006844 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.007031 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.007158 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.007369 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.007496 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.007687 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.007814 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.007999 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.008127 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.008310 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.008429 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.008624 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.008889 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.009016 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.009128 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.009238 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.009357 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.009519 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.009647 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.009827 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.009945 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.010126 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.010255 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.010426 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.010554 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.010801 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.010928 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.011048 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.011214 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.011351 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.011550 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.011677 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.011798 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.011910 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.012168 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.012305 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.012426 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.012546 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.012700 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.012836 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.013031 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 00:54:58.013148 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.013376 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.013676 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.013977 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.014316 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.014617 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.014941 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.015270 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.015598 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.015915 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.016227 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.016600 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.016847 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.017175 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.017491 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.017805 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.018114 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.018484 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.018931 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.019114 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.019693 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.020018 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.020332 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.020644 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.020958 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.021267 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.021576 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.021880 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.022188 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.022496 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.022805 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.023133 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.023472 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.023797 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.024128 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.024440 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.024750 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.025061 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.025370 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.025732 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.026041 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.026343 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.026739 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.026965 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.027318 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.027604 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.027912 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.028783 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.028783 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.029282 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.029282 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.029567 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.029819 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.030145 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.030479 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.030799 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.031110 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.031446 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.031763 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.032290 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.032607 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.032935 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.033258 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.033579 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.033944 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.034265 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.034593 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.034898 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.035216 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.035524 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.035836 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.036140 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.036460 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.036769 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.037068 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.037384 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.037691 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.038223 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.038579 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.038896 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.039245 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.039574 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.039894 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.040202 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.040531 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.040840 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.041148 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.041458 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.041787 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.042069 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.042373 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.042687 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.044062 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.044062 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.044062 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.044062 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.044646 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.044646 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.045031 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.045210 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.045518 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.045826 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.046543 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.046791 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.047147 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.047421 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.047724 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.048135 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.048437 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.048744 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.049090 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.049410 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.049727 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.050050 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.050352 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.050654 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.050968 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.051323 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.051642 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.051954 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.052260 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.052609 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.052961 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.053488 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.053822 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.054175 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.054463 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.054794 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.055100 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.055429 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.055736 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.056059 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.056378 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.056689 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.056997 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.057304 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.057608 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.057914 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.058225 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.058533 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.058839 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.059145 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.059542 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.059776 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.060084 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.060395 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.060709 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.061051 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.061458 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.061683 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.062012 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.062305 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.062613 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.062921 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.063265 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.063572 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.063882 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.064273 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.064513 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.064816 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.065307 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.065622 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.065940 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.066257 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.066563 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.066886 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.067917 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.067917 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.067917 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.068380 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.068531 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.068773 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.069099 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.069422 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.069737 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.070013 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.070314 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.070619 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.070935 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.071291 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.071591 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.072498 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.072498 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.072498 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.072935 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.073095 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.073355 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.073679 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.073939 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.074385 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.074556 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.074816 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.075115 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.075305 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO dbcounter [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] Registered counter for database nova_api Sep 11 00:54:58.075457 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.075739 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.076040 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.076340 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.076640 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.076940 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.077241 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.077616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.077920 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.078258 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.078526 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.078835 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.079157 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.079486 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.079821 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.080123 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.082848 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.082848 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.082848 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.082848 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.082848 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.082848 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.082848 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.082848 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.084544 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.084544 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.084544 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.084544 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.084544 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.084544 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.085511 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.085511 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.085511 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.085930 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.085930 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.086212 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.086477 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.086781 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.087086 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.087420 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.087727 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.088033 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.088350 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.088662 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.088988 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.089312 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.089618 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.089980 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.090423 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.090720 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.091039 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.091513 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.091734 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.092035 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.092346 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.092818 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:54:58.093052 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 00:54:58.097107 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_db.sqlalchemy.engines [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:54:58.104003 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writer thread running {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:54:58.157858 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO dbcounter [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] Registered counter for database nova_api Sep 11 00:54:58.163914 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.context [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8719ce5-7462-4db4-8ae0-e38f988a1e8a(cell1) {{(pid=120496) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 00:54:58.168065 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:54:58.168540 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:54:58.170109 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:54:58.170973 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:54:58.171709 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:54:58.174021 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:54:58.176234 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO dbcounter [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] Registered counter for database nova_cell0 Sep 11 00:54:58.178876 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_db.sqlalchemy.engines [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:54:58.180527 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO dbcounter [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] Registered counter for database nova_cell1 Sep 11 00:54:58.185516 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writer thread running {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:54:58.187921 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_db.sqlalchemy.engines [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:54:58.189670 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_db.sqlalchemy.engines [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:54:58.199006 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writer thread running {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:54:58.199409 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writer thread running {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:54:58.242399 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.context [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8719ce5-7462-4db4-8ae0-e38f988a1e8a(cell1) {{(pid=120497) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 00:54:58.246594 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:54:58.246976 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:54:58.248615 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:54:58.249353 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:54:58.249797 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:54:58.251815 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:54:58.253901 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO dbcounter [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] Registered counter for database nova_cell0 Sep 11 00:54:58.257936 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO dbcounter [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] Registered counter for database nova_cell1 Sep 11 00:54:58.270102 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_db.sqlalchemy.engines [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:54:58.271510 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_db.sqlalchemy.engines [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:54:58.278179 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writer thread running {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:54:58.279806 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writer thread running {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:54:58.373867 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO dbcounter [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] Registered counter for database nova_cell0 Sep 11 00:54:58.380915 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_db.sqlalchemy.engines [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:54:58.385812 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writer thread running {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:54:58.426347 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO dbcounter [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] Registered counter for database nova_cell0 Sep 11 00:54:58.433852 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_db.sqlalchemy.engines [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:54:58.438457 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writer thread running {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:54:58.715119 dv-cinder-master-3-smb devstack@n-api.service[120496]: WARNING keystonemiddleware.auth_token [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 00:54:58.722664 dv-cinder-master-3-smb devstack@n-api.service[120496]: WARNING keystonemiddleware.auth_token [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 00:54:58.750191 dv-cinder-master-3-smb devstack@n-api.service[120497]: WARNING keystonemiddleware.auth_token [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 00:54:58.756191 dv-cinder-master-3-smb devstack@n-api.service[120497]: WARNING keystonemiddleware.auth_token [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 00:54:59.065384 dv-cinder-master-3-smb devstack@n-api.service[120496]: WARNING keystonemiddleware.auth_token [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 00:54:59.071396 dv-cinder-master-3-smb devstack@n-api.service[120496]: WARNING keystonemiddleware.auth_token [None req-70da1601-49df-42b5-bf30-5ac077e41de7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 00:54:59.076836 dv-cinder-master-3-smb devstack@n-api.service[120496]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b6a7619c0 pid: 120496 (default app) Sep 11 00:54:59.099335 dv-cinder-master-3-smb devstack@n-api.service[120497]: WARNING keystonemiddleware.auth_token [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 00:54:59.105403 dv-cinder-master-3-smb devstack@n-api.service[120497]: WARNING keystonemiddleware.auth_token [None req-ef077343-ab94-49a0-b3e2-50a2cee8324c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 00:54:59.110713 dv-cinder-master-3-smb devstack@n-api.service[120497]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b6a7619c0 pid: 120497 (default app) Sep 11 00:55:34.520204 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:34.524009 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:34.524009 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:34.524009 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:35.891554 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ddd3b9e2-687b-45ac-b430-b99f45d22861 tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] Action: 'create', calling method: .version_select at 0x7fbb916f04c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-121640790", "metadata": {"Type": "work"}}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:55:37.765439 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ddd3b9e2-687b-45ac-b430-b99f45d22861 tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.262355 Sep 11 00:55:37.766817 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Sep 11 00:55:34 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3265 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 11 00:55:37.789242 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=3 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:37.790106 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=3 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:37.796044 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=3 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:37.799960 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=3 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:38.146978 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-bac4b5bd-5406-4196-b8f3-295487b7df7f tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] Calling method '.version_select at 0x7fbb9173f0d0>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:55:38.867303 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-bac4b5bd-5406-4196-b8f3-295487b7df7f tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1d3eac84-8cf2-4769-8a35-ce4ed5172f20" status: 200 len: 353 microversion: 2.1 time: 1.086539 Sep 11 00:55:38.871231 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 1/2] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Sep 11 00:55:37 2022] GET /compute/v2.1/os-volumes/1d3eac84-8cf2-4769-8a35-ce4ed5172f20 => generated 353 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:55:38.884413 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-66bd090e-4612-4d81-9b66-401decc6a48d tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] Calling method '.version_select at 0x7fbb915c63a0>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:55:38.992672 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-66bd090e-4612-4d81-9b66-401decc6a48d tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1d3eac84-8cf2-4769-8a35-ce4ed5172f20" status: 200 len: 353 microversion: 2.1 time: 0.113184 Sep 11 00:55:38.994509 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Sep 11 00:55:38 2022] GET /compute/v2.1/os-volumes/1d3eac84-8cf2-4769-8a35-ce4ed5172f20 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:55:39.021118 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f2f08cab-f881-4bfc-8e0f-d1af318f543c tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] Calling method '.version_select at 0x7fbb91603310>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:55:39.163571 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f2f08cab-f881-4bfc-8e0f-d1af318f543c tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/1d3eac84-8cf2-4769-8a35-ce4ed5172f20" status: 202 len: 0 microversion: 2.1 time: 0.150333 Sep 11 00:55:39.164123 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Sep 11 00:55:39 2022] DELETE /compute/v2.1/os-volumes/1d3eac84-8cf2-4769-8a35-ce4ed5172f20 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:55:39.178705 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4247d4cd-3324-4e4a-9cc9-17c87c8fadc6 tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] Calling method '.version_select at 0x7fbb915c6a60>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:55:39.266514 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4247d4cd-3324-4e4a-9cc9-17c87c8fadc6 tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1d3eac84-8cf2-4769-8a35-ce4ed5172f20" status: 200 len: 352 microversion: 2.1 time: 0.097768 Sep 11 00:55:39.267089 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Sep 11 00:55:39 2022] GET /compute/v2.1/os-volumes/1d3eac84-8cf2-4769-8a35-ce4ed5172f20 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:55:40.282653 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-217ee271-8511-4752-8daf-0c42f8d330a8 tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] Calling method '.version_select at 0x7fbb916039d0>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:55:40.327470 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-217ee271-8511-4752-8daf-0c42f8d330a8 tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] HTTP exception thrown: Volume 1d3eac84-8cf2-4769-8a35-ce4ed5172f20 could not be found. Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-217ee271-8511-4752-8daf-0c42f8d330a8 tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] Request method failure captured: Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/os-volumes/1d3eac84-8cf2-4769-8a35-ce4ed5172f20 HTTP/1.1 Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTIGcy7fjSVEEyxsmcTv-V_yoLCiO1oYDtgyQIQ9RdOBwTLbylRfUzFU5Yh6vJ3eR_3Mh5UZIFNxGrZMi-aWnreQqgju9leJP83RTpi1X5Y-wF-d-tDY5HxO1gOmW5Q2VNv-nRiwceKBbh4mGI-8iEHjiNd-5BBXH4I5wQGPdPjNCmM Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 9592f4e25e1e456fa2aecdf1e14b5af3 Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-VolumesGetTestJSON-1918533594 Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 00:55:40.331803 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 00:55:40.333032 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9592f4e25e1e456fa2aecdf1e14b5af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9592f4e25e1e456fa2aecdf1e14b5af3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9592f4e25e1e456fa2aecdf1e14b5af3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9592f4e25e1e456fa2aecdf1e14b5af3", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:55:40.333032 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-VolumesGetTestJSON-1918533594 Sep 11 00:55:40.333032 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 9592f4e25e1e456fa2aecdf1e14b5af3 Sep 11 00:55:40.333032 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-VolumesGetTestJSON-1918533594 Sep 11 00:55:40.333032 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-VolumesGetTestJSON-1918533594-project Sep 11 00:55:40.333032 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 00:55:40.333032 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 00:55:40.333032 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 9ec70451a9e04c2fb6dbb7d2f49e1b20 Sep 11 00:55:40.333032 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-VolumesGetTestJSON-1918533594-project Sep 11 00:55:40.333032 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: Sep 11 00:55:40.333032 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Volume 1d3eac84-8cf2-4769-8a35-ce4ed5172f20 could not be found. Sep 11 00:55:40.333032 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': '1d3eac84-8cf2-4769-8a35-ce4ed5172f20'} Sep 11 00:55:40.333032 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d3eac84-8cf2-4769-8a35-ce4ed5172f20 could not be found. (HTTP 404) (Request-ID: req-354be364-4ffa-4c64-916e-8e02b9558f6d) Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:55:40.333793 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 00:55:40.334857 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d3eac84-8cf2-4769-8a35-ce4ed5172f20 could not be found. Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 00:55:40.335957 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:55:40.337063 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d3eac84-8cf2-4769-8a35-ce4ed5172f20 could not be found. Sep 11 00:55:40.337063 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:55:40.337063 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:55:40.337063 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:55:40.337063 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:55:40.337063 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:55:40.337063 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:55:40.337063 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:55:40.337063 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:55:40.337063 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d3eac84-8cf2-4769-8a35-ce4ed5172f20 could not be found. Sep 11 00:55:40.337063 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:55:40.338942 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-217ee271-8511-4752-8daf-0c42f8d330a8 tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] Returning 404 to user: Volume 1d3eac84-8cf2-4769-8a35-ce4ed5172f20 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:55:40.339951 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-217ee271-8511-4752-8daf-0c42f8d330a8 tempest-VolumesGetTestJSON-1918533594 tempest-VolumesGetTestJSON-1918533594-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1d3eac84-8cf2-4769-8a35-ce4ed5172f20" status: 404 len: 109 microversion: 2.1 time: 0.062060 Sep 11 00:55:40.340937 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 3/6] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Sep 11 00:55:40 2022] GET /compute/v2.1/os-volumes/1d3eac84-8cf2-4769-8a35-ce4ed5172f20 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:55:47.758900 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d7a39427-90d1-44e2-ba46-e4e53869fe2f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Action: 'create', calling method: .version_select at 0x7fbb91562040>, body: {"keypair": {"name": "tempest-keypair-484697336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOFT+DXTw68L7kfYuCm3fCfcCZp97mZWXZYAo2OUq08Kn47CaCMXS83wKlPXrvO5lF9p9qH8N1ntIRyeBSubnvkepk4Vu6RUVv0G6WleWzKYDYCYV1jffqBuSDwcCAQEw=="}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:55:47.966923 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-d7a39427-90d1-44e2-ba46-e4e53869fe2f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Getting quotas for project 1bf8c10e733e485f9ac63769727b7151. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:55:47.997016 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-d7a39427-90d1-44e2-ba46-e4e53869fe2f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Getting quotas for user 44c365d540894a908b34fe51d854e96e and project 1bf8c10e733e485f9ac63769727b7151. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:55:48.126820 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d7a39427-90d1-44e2-ba46-e4e53869fe2f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.665604 Sep 11 00:55:48.128370 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 4/7] 10.222.0.23 () {62 vars in 1200 bytes} [Sun Sep 11 00:55:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 668 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 11 00:55:54.323267 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d5e1f6ab-e973-497b-bdf8-71a36bc0073e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Action: 'create', calling method: .version_select at 0x7fbb9158e9d0>, body: {"keypair": {"name": "tempest-keypair-97942345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkMYwWVOq0yiI+fsbtrbYXKTwPY6VGkj6CP7vjy8P96bUtotX0SAp2JN5hk16I7FwxjVSLOooJNp4cjM74tuoFyrsIQVu93Xv8G68DX5aavQxEPLJq8yICgtuu2Ik89rA=="}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:55:54.496507 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-271077927", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:55:54.515420 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-d5e1f6ab-e973-497b-bdf8-71a36bc0073e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'key_pairs'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:55:54.553008 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-d5e1f6ab-e973-497b-bdf8-71a36bc0073e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for user 364cf4a7a3bf4e70973c78a5d690e998 and project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'key_pairs'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:55:54.783361 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d5e1f6ab-e973-497b-bdf8-71a36bc0073e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.728509 Sep 11 00:55:54.784275 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 4/8] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Sep 11 00:55:54 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:55:54.817080 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] validate_networks() for [('b1a0b51b-f6ee-4db0-9e52-fee1b0240c49', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:55:54.896439 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8d42c359-3708-4977-b848-e2ee8bf78843 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Action: 'create', calling method: .version_select at 0x7fbb915141f0>, body: {"keypair": {"name": "tempest-keypair-569059288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHb7/Xyvfa1NL2bzfEm5VwOzmezylWHcRUF5t719Q7zH52DBjDbnRmk/ZZu951SlUg6/u0Xg3YwI2Zm+EfKqpg/nqhkQtyQ43D18VD05MEUshtq39pJzhnlOXiv+AnpOVQ=="}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:55:54.934415 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-8d42c359-3708-4977-b848-e2ee8bf78843 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Getting quotas for project 4dec451848364c2787673580ec4c90c1. Resources: {'key_pairs'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:55:54.946273 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-8d42c359-3708-4977-b848-e2ee8bf78843 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Getting quotas for user 081d365c7b15443aa76c7da2ca444a8e and project 4dec451848364c2787673580ec4c90c1. Resources: {'key_pairs'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:55:55.006881 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8d42c359-3708-4977-b848-e2ee8bf78843 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.221352 Sep 11 00:55:55.017044 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 5/9] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Sep 11 00:55:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:55:56.735909 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1838851812", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "networks": [{"uuid": "206a59e6-07d5-4e2e-9c3c-44b35c05f9b2"}]}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:55:56.928923 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:55:56.929991 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:55:56.931042 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:55:56.931722 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:55:56.932392 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:55:56.949329 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.network.neutron [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] validate_networks() for [('206a59e6-07d5-4e2e-9c3c-44b35c05f9b2', None, None, None, None, None)] {{(pid=120497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:55:56.967209 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:55:56.970711 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:55:56.972331 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:55:56.975059 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:55:56.975738 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:55:56.977865 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:55:57.045918 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Getting quotas for project ac8c0850e1ac43e7913a88dbb7b7e9f8. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:55:57.053641 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Getting quotas for user 03a3c989ecef42e084fb44d47c55b27e and project ac8c0850e1ac43e7913a88dbb7b7e9f8. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:55:57.081738 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:55:57.084936 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:55:57.229448 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-08577c77-8b47-4bab-89c6-b76446fa6c0d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.104773 Sep 11 00:55:57.232548 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 5/10] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 00:55:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 3112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:55:57.244309 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1539752116", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f977a90a-6e82-460e-bc39-8812d8dfe3bd"}], "security_groups": [{"name": "tempest-securitygroup--1090661348"}], "key_name": "tempest-keypair-484697336", "user_data": "}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:55:58.226231 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] validate_networks() for [('f977a90a-6e82-460e-bc39-8812d8dfe3bd', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:56:00.017401 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Flavor limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:56:00.018444 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Image limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:56:00.019100 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Flavor pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:56:00.019712 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Image pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:56:00.020307 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:56:00.053963 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:00.055078 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:56:00.055917 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:56:00.056077 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:56:00.056459 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:56:00.057056 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:56:00.059733 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:00.061687 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:00.062996 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:00.065974 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:00.066693 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:00.076529 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:00.076913 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:00.077312 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:00.078031 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:00.085057 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:00.085507 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:00.165091 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Getting quotas for project 1bf8c10e733e485f9ac63769727b7151. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:56:00.172759 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Getting quotas for project a2d58c81f2e94dd79d2fdcf08b260636. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:56:00.181765 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Getting quotas for user 44c365d540894a908b34fe51d854e96e and project 1bf8c10e733e485f9ac63769727b7151. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:56:00.183839 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Getting quotas for user f06b14789a2740eca22001c0b5232fc4 and project a2d58c81f2e94dd79d2fdcf08b260636. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:56:00.225191 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:56:00.226328 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Going to run 1 instances... {{(pid=120497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:56:00.231579 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:56:00.233767 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:56:00.335787 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b4322c81-644b-43bc-96ad-441852305f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.099596 Sep 11 00:56:00.336567 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 6/11] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Sep 11 00:55:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 3103 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 11 00:56:00.349803 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-68c52ee1-5dcc-48da-8130-e4ba0c828e35 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:00.360168 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-68c52ee1-5dcc-48da-8130-e4ba0c828e35 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:00.391230 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c9701c54-9ad6-4cb4-a7f1-ed2a6c82aea9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.832540 Sep 11 00:56:00.396136 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 6/12] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 00:55:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:56:00.398114 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68c52ee1-5dcc-48da-8130-e4ba0c828e35 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:00.398604 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68c52ee1-5dcc-48da-8130-e4ba0c828e35 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:00.401848 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68c52ee1-5dcc-48da-8130-e4ba0c828e35 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:00.404123 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68c52ee1-5dcc-48da-8130-e4ba0c828e35 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:00.410565 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68c52ee1-5dcc-48da-8130-e4ba0c828e35 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:00.411052 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68c52ee1-5dcc-48da-8130-e4ba0c828e35 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:00.435725 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-65106179", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab04b06f-ad0d-401a-9169-4aa7681cc0d9"}], "security_groups": [{"name": "tempest-securitygroup--1040816049"}], "key_name": "tempest-keypair-569059288", "user_data": "}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:00.779596 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-68c52ee1-5dcc-48da-8130-e4ba0c828e35 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:00.911210 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-68c52ee1-5dcc-48da-8130-e4ba0c828e35 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1273 microversion: 2.1 time: 0.567445 Sep 11 00:56:00.916460 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:00 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1273 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:00.930826 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4b8ca134-1e8d-44ec-9dcf-f0169cdc8b69 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:00.931488 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4b8ca134-1e8d-44ec-9dcf-f0169cdc8b69 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:00.998027 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.network.neutron [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] validate_networks() for [('ab04b06f-ad0d-401a-9169-4aa7681cc0d9', None, None, None, None, None)] {{(pid=120497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:56:01.829668 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4b8ca134-1e8d-44ec-9dcf-f0169cdc8b69 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:01.874171 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4b8ca134-1e8d-44ec-9dcf-f0169cdc8b69 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:01.879544 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4b8ca134-1e8d-44ec-9dcf-f0169cdc8b69 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:01.882655 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4b8ca134-1e8d-44ec-9dcf-f0169cdc8b69 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1281 microversion: 2.20 time: 0.965348 Sep 11 00:56:01.895855 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 8/14] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:56:00 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1281 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:56:01.901679 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-768b588f-1ca4-429f-9efe-ea4aff26a8bc tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:01.902642 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-768b588f-1ca4-429f-9efe-ea4aff26a8bc tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:01.938016 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-768b588f-1ca4-429f-9efe-ea4aff26a8bc tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:01.940423 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-768b588f-1ca4-429f-9efe-ea4aff26a8bc tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:01.942293 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-768b588f-1ca4-429f-9efe-ea4aff26a8bc tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:01.943417 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-768b588f-1ca4-429f-9efe-ea4aff26a8bc tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:01.944911 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-768b588f-1ca4-429f-9efe-ea4aff26a8bc tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:01.946253 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-768b588f-1ca4-429f-9efe-ea4aff26a8bc tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:02.304501 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-768b588f-1ca4-429f-9efe-ea4aff26a8bc tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:02.328462 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-768b588f-1ca4-429f-9efe-ea4aff26a8bc tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1219 microversion: 2.1 time: 0.430833 Sep 11 00:56:02.331812 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 9/15] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:01 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1219 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:02.350286 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-746082290", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "245b555a-f171-4b26-8562-bbe3df87effe"}], "security_groups": [{"name": "tempest-securitygroup--459395799"}], "key_name": "tempest-keypair-97942345", "user_data": "}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:03.398912 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] validate_networks() for [('245b555a-f171-4b26-8562-bbe3df87effe', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:56:04.084421 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Flavor limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:56:04.093066 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Image limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:56:04.094078 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Flavor pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:56:04.094711 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Image pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:56:04.096285 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:56:04.125281 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:04.129503 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:04.130375 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:04.141322 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:04.145464 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:04.145996 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:04.238112 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Getting quotas for project 4dec451848364c2787673580ec4c90c1. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:56:04.251542 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Getting quotas for user 081d365c7b15443aa76c7da2ca444a8e and project 4dec451848364c2787673580ec4c90c1. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:56:04.302783 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Going to run 1 instances... {{(pid=120497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:56:04.310242 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:56:04.444123 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-39afad20-bc12-4b8b-8819-47f345280c67 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.046549 Sep 11 00:56:04.448248 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 7/16] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 00:56:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 4052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:56:04.468882 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-712593037", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:04.677604 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.network.neutron [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] validate_networks() for [('b1a0b51b-f6ee-4db0-9e52-fee1b0240c49', None, None, None, None, None)] {{(pid=120497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:56:07.623539 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:56:07.624777 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:56:07.625988 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:56:07.626736 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:56:07.627430 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:56:07.649102 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:07.649937 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:07.654494 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:07.655863 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:07.656683 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:07.657735 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:07.781537 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:56:07.808661 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for user 364cf4a7a3bf4e70973c78a5d690e998 and project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:56:07.892935 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:56:07.895801 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:56:08.069328 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c27fa15d-9c80-4c50-9a15-eccaddf185ec tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.735233 Sep 11 00:56:08.070459 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 10/17] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 00:56:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 5738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:56:08.094710 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-284e0e3a-39ef-4b21-b700-7d589bbc6cb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:08.095505 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-284e0e3a-39ef-4b21-b700-7d589bbc6cb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:08.110845 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-284e0e3a-39ef-4b21-b700-7d589bbc6cb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:08.111550 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-284e0e3a-39ef-4b21-b700-7d589bbc6cb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:08.112141 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-284e0e3a-39ef-4b21-b700-7d589bbc6cb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:08.113041 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-284e0e3a-39ef-4b21-b700-7d589bbc6cb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:08.113632 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-284e0e3a-39ef-4b21-b700-7d589bbc6cb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:08.114294 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-284e0e3a-39ef-4b21-b700-7d589bbc6cb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:08.845043 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-284e0e3a-39ef-4b21-b700-7d589bbc6cb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:08.867066 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-284e0e3a-39ef-4b21-b700-7d589bbc6cb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:08.880454 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-284e0e3a-39ef-4b21-b700-7d589bbc6cb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:08.886549 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-284e0e3a-39ef-4b21-b700-7d589bbc6cb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1339 microversion: 2.20 time: 0.814369 Sep 11 00:56:08.899588 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 11/18] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:56:08 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1339 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:56:08.911198 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2aa6a665-681e-4f8d-8f00-45e4729a4b14 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:08.912084 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2aa6a665-681e-4f8d-8f00-45e4729a4b14 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:08.919057 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2aa6a665-681e-4f8d-8f00-45e4729a4b14 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:08.920141 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2aa6a665-681e-4f8d-8f00-45e4729a4b14 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:08.920850 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2aa6a665-681e-4f8d-8f00-45e4729a4b14 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:08.921760 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2aa6a665-681e-4f8d-8f00-45e4729a4b14 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:08.922502 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2aa6a665-681e-4f8d-8f00-45e4729a4b14 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:08.923504 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2aa6a665-681e-4f8d-8f00-45e4729a4b14 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:09.233700 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-2aa6a665-681e-4f8d-8f00-45e4729a4b14 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:09.245350 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2aa6a665-681e-4f8d-8f00-45e4729a4b14 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1273 microversion: 2.1 time: 0.344536 Sep 11 00:56:09.246066 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 12/19] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:08 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:09.266061 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2a5d5259-4803-4f5f-b475-d1bc5d12e0f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:09.271544 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2a5d5259-4803-4f5f-b475-d1bc5d12e0f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:09.289673 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a5d5259-4803-4f5f-b475-d1bc5d12e0f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:09.290175 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a5d5259-4803-4f5f-b475-d1bc5d12e0f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:09.290630 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a5d5259-4803-4f5f-b475-d1bc5d12e0f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:09.292791 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a5d5259-4803-4f5f-b475-d1bc5d12e0f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:09.293425 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a5d5259-4803-4f5f-b475-d1bc5d12e0f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:09.294039 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a5d5259-4803-4f5f-b475-d1bc5d12e0f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:09.853102 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Flavor limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:56:09.854014 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-2a5d5259-4803-4f5f-b475-d1bc5d12e0f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:09.854907 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Image limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:56:09.856661 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Flavor pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:56:09.860384 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Image pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:56:09.861554 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:56:09.869656 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2a5d5259-4803-4f5f-b475-d1bc5d12e0f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1293 microversion: 2.1 time: 0.616125 Sep 11 00:56:09.888264 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 13/20] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:09 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1293 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:09.893015 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:09.893482 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5a2ed4cf-7d42-4dc7-9f00-dd6ec692ae64 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:09.894345 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5a2ed4cf-7d42-4dc7-9f00-dd6ec692ae64 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:09.897702 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:09.900169 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:09.901628 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:09.906136 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:09.907994 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a2ed4cf-7d42-4dc7-9f00-dd6ec692ae64 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:09.908792 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a2ed4cf-7d42-4dc7-9f00-dd6ec692ae64 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:09.909340 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:09.909650 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a2ed4cf-7d42-4dc7-9f00-dd6ec692ae64 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:09.910582 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a2ed4cf-7d42-4dc7-9f00-dd6ec692ae64 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:09.911199 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a2ed4cf-7d42-4dc7-9f00-dd6ec692ae64 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:09.911818 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a2ed4cf-7d42-4dc7-9f00-dd6ec692ae64 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:10.008567 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Getting quotas for project ac8c0850e1ac43e7913a88dbb7b7e9f8. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:56:10.022358 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Getting quotas for user 03a3c989ecef42e084fb44d47c55b27e and project ac8c0850e1ac43e7913a88dbb7b7e9f8. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:56:10.071534 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-5a2ed4cf-7d42-4dc7-9f00-dd6ec692ae64 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:10.079737 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Going to run 1 instances... {{(pid=120497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:56:10.085099 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:56:10.114692 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5a2ed4cf-7d42-4dc7-9f00-dd6ec692ae64 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1235 microversion: 2.1 time: 0.216752 Sep 11 00:56:10.118108 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 14/21] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:09 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1235 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:10.141176 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0d630bc2-4ef7-400b-a071-3d01c0625bd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:10.141799 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0d630bc2-4ef7-400b-a071-3d01c0625bd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:10.182676 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d630bc2-4ef7-400b-a071-3d01c0625bd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:10.183556 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d630bc2-4ef7-400b-a071-3d01c0625bd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:10.191975 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d630bc2-4ef7-400b-a071-3d01c0625bd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:10.192757 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d630bc2-4ef7-400b-a071-3d01c0625bd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:10.193195 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d630bc2-4ef7-400b-a071-3d01c0625bd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:10.193624 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d630bc2-4ef7-400b-a071-3d01c0625bd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:10.287601 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-991442c1-be3d-49f7-ad48-e56686b8c59a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.833256 Sep 11 00:56:10.291562 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 8/22] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 00:56:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 5838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:56:10.314718 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-68862600-2944-45b4-b893-93adf26d1cb9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:10.329982 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-68862600-2944-45b4-b893-93adf26d1cb9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:10.377090 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-68862600-2944-45b4-b893-93adf26d1cb9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:10.379416 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-68862600-2944-45b4-b893-93adf26d1cb9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:10.381524 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-68862600-2944-45b4-b893-93adf26d1cb9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:10.385321 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-68862600-2944-45b4-b893-93adf26d1cb9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:10.391149 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-68862600-2944-45b4-b893-93adf26d1cb9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:10.392399 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-68862600-2944-45b4-b893-93adf26d1cb9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:11.978316 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-68862600-2944-45b4-b893-93adf26d1cb9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:12.037825 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-68862600-2944-45b4-b893-93adf26d1cb9 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1315 microversion: 2.1 time: 1.743323 Sep 11 00:56:12.051313 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 9/23] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:10 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1315 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:12.068131 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a4288522-9a5c-49a3-865c-56a45048e875 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:12.069121 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a4288522-9a5c-49a3-865c-56a45048e875 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:12.107909 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a4288522-9a5c-49a3-865c-56a45048e875 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:12.109299 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a4288522-9a5c-49a3-865c-56a45048e875 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:12.122829 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a4288522-9a5c-49a3-865c-56a45048e875 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:12.124100 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a4288522-9a5c-49a3-865c-56a45048e875 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:12.131215 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a4288522-9a5c-49a3-865c-56a45048e875 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:12.131886 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a4288522-9a5c-49a3-865c-56a45048e875 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:12.677861 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0d630bc2-4ef7-400b-a071-3d01c0625bd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:12.702446 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0d630bc2-4ef7-400b-a071-3d01c0625bd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:12.724140 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0d630bc2-4ef7-400b-a071-3d01c0625bd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:12.735981 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0d630bc2-4ef7-400b-a071-3d01c0625bd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1407 microversion: 2.20 time: 2.607352 Sep 11 00:56:12.736654 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 15/24] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:56:10 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1407 bytes in 2618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:56:12.757684 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-27071792-eab0-413a-8b54-e5c5471aa32e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:12.760519 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-27071792-eab0-413a-8b54-e5c5471aa32e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:12.787395 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27071792-eab0-413a-8b54-e5c5471aa32e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:12.787969 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27071792-eab0-413a-8b54-e5c5471aa32e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:12.788423 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27071792-eab0-413a-8b54-e5c5471aa32e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:12.792277 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27071792-eab0-413a-8b54-e5c5471aa32e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:12.793716 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27071792-eab0-413a-8b54-e5c5471aa32e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:12.794389 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27071792-eab0-413a-8b54-e5c5471aa32e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:12.948734 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a4288522-9a5c-49a3-865c-56a45048e875 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:12.958454 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a4288522-9a5c-49a3-865c-56a45048e875 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1217 microversion: 2.1 time: 0.905619 Sep 11 00:56:12.961011 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 10/25] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:12 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1217 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:12.975851 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3c9f8983-f7a7-415a-83d3-cd3476122ad0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:12.976719 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3c9f8983-f7a7-415a-83d3-cd3476122ad0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:12.989531 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c9f8983-f7a7-415a-83d3-cd3476122ad0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:12.990244 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c9f8983-f7a7-415a-83d3-cd3476122ad0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:12.990452 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c9f8983-f7a7-415a-83d3-cd3476122ad0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:12.991216 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c9f8983-f7a7-415a-83d3-cd3476122ad0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:12.997169 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c9f8983-f7a7-415a-83d3-cd3476122ad0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:12.997616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c9f8983-f7a7-415a-83d3-cd3476122ad0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:13.379711 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3c9f8983-f7a7-415a-83d3-cd3476122ad0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:13.387566 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3c9f8983-f7a7-415a-83d3-cd3476122ad0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1297 microversion: 2.1 time: 0.425306 Sep 11 00:56:13.403147 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 11/26] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:12 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1297 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:13.599165 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-27071792-eab0-413a-8b54-e5c5471aa32e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:13.616385 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-27071792-eab0-413a-8b54-e5c5471aa32e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 0.878095 Sep 11 00:56:13.620543 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 16/27] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:12 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:13.637662 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-15e4b00c-983d-48bc-941f-0948fcc749ab tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:13.638333 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-15e4b00c-983d-48bc-941f-0948fcc749ab tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:13.665907 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15e4b00c-983d-48bc-941f-0948fcc749ab tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:13.671441 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15e4b00c-983d-48bc-941f-0948fcc749ab tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:13.672173 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15e4b00c-983d-48bc-941f-0948fcc749ab tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:13.678382 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15e4b00c-983d-48bc-941f-0948fcc749ab tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:13.682152 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15e4b00c-983d-48bc-941f-0948fcc749ab tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:13.686786 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15e4b00c-983d-48bc-941f-0948fcc749ab tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:13.813426 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-bbd8ae4f-a7db-4820-9379-dca2373ecb8a req-c9fbc522-22b3-40e0-900f-12eede8e09a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda4760f-be50-4efe-808f-d4ab2c0358f4", "tag": "0a23eaa3-e9b6-4004-81da-c5fb16fac3ac"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:13.869818 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-bbd8ae4f-a7db-4820-9379-dca2373ecb8a req-c9fbc522-22b3-40e0-900f-12eede8e09a6 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:13.870338 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-bbd8ae4f-a7db-4820-9379-dca2373ecb8a req-c9fbc522-22b3-40e0-900f-12eede8e09a6 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:13.870744 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-bbd8ae4f-a7db-4820-9379-dca2373ecb8a req-c9fbc522-22b3-40e0-900f-12eede8e09a6 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:13.993117 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-bbd8ae4f-a7db-4820-9379-dca2373ecb8a req-c9fbc522-22b3-40e0-900f-12eede8e09a6 service nova] Creating event network-changed:0a23eaa3-e9b6-4004-81da-c5fb16fac3ac for instance eda4760f-be50-4efe-808f-d4ab2c0358f4 on hv-cinder-maste Sep 11 00:56:13.993907 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-bbd8ae4f-a7db-4820-9379-dca2373ecb8a req-c9fbc522-22b3-40e0-900f-12eede8e09a6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120497) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 11 00:56:13.994521 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-bbd8ae4f-a7db-4820-9379-dca2373ecb8a req-c9fbc522-22b3-40e0-900f-12eede8e09a6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120497) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 11 00:56:13.999675 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-102d377a-d753-4fc3-8e4f-b43e35c33b70 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:14.006617 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-102d377a-d753-4fc3-8e4f-b43e35c33b70 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:14.007339 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-102d377a-d753-4fc3-8e4f-b43e35c33b70 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:14.008750 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-102d377a-d753-4fc3-8e4f-b43e35c33b70 None None] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:14.013973 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-102d377a-d753-4fc3-8e4f-b43e35c33b70 None None] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:14.014897 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-102d377a-d753-4fc3-8e4f-b43e35c33b70 None None] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:14.038441 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.compute.rpcapi [None req-102d377a-d753-4fc3-8e4f-b43e35c33b70 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 11 00:56:14.040389 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-102d377a-d753-4fc3-8e4f-b43e35c33b70 None None] Releasing lock "compute-rpcapi-router" {{(pid=120497) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 11 00:56:14.083270 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-102d377a-d753-4fc3-8e4f-b43e35c33b70 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.678467 Sep 11 00:56:14.084091 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 12/28] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:56:14.092913 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f2310648-3c4e-4e9f-99b4-af52196a274d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:14.093888 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f2310648-3c4e-4e9f-99b4-af52196a274d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:14.102939 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2310648-3c4e-4e9f-99b4-af52196a274d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:14.103767 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2310648-3c4e-4e9f-99b4-af52196a274d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:14.105109 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2310648-3c4e-4e9f-99b4-af52196a274d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:14.106971 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2310648-3c4e-4e9f-99b4-af52196a274d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:14.108003 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2310648-3c4e-4e9f-99b4-af52196a274d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:14.109083 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2310648-3c4e-4e9f-99b4-af52196a274d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:15.373282 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-15e4b00c-983d-48bc-941f-0948fcc749ab tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:15.388523 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-15e4b00c-983d-48bc-941f-0948fcc749ab tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1315 microversion: 2.1 time: 1.766463 Sep 11 00:56:15.389448 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 17/29] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:13 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1315 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:15.400243 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e7d8f324-8af3-4985-bf9b-c1b099fe6c45 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:15.406720 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e7d8f324-8af3-4985-bf9b-c1b099fe6c45 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:15.420586 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7d8f324-8af3-4985-bf9b-c1b099fe6c45 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:15.421501 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7d8f324-8af3-4985-bf9b-c1b099fe6c45 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:15.422206 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7d8f324-8af3-4985-bf9b-c1b099fe6c45 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:15.423430 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7d8f324-8af3-4985-bf9b-c1b099fe6c45 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:15.424104 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7d8f324-8af3-4985-bf9b-c1b099fe6c45 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:15.424834 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7d8f324-8af3-4985-bf9b-c1b099fe6c45 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:15.699693 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e7d8f324-8af3-4985-bf9b-c1b099fe6c45 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:15.708555 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e7d8f324-8af3-4985-bf9b-c1b099fe6c45 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1279 microversion: 2.1 time: 0.317786 Sep 11 00:56:15.716416 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 18/30] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:15 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1279 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:15.725521 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b4cb8aaa-6c79-460f-91e0-81836f9b196d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:15.734497 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b4cb8aaa-6c79-460f-91e0-81836f9b196d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:15.754412 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4cb8aaa-6c79-460f-91e0-81836f9b196d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:15.755237 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4cb8aaa-6c79-460f-91e0-81836f9b196d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:15.755883 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4cb8aaa-6c79-460f-91e0-81836f9b196d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:15.756741 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4cb8aaa-6c79-460f-91e0-81836f9b196d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:15.757559 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4cb8aaa-6c79-460f-91e0-81836f9b196d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:15.758152 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4cb8aaa-6c79-460f-91e0-81836f9b196d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:15.916262 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f2310648-3c4e-4e9f-99b4-af52196a274d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:15.930705 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f2310648-3c4e-4e9f-99b4-af52196a274d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:15.942731 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f2310648-3c4e-4e9f-99b4-af52196a274d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:15.944847 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f2310648-3c4e-4e9f-99b4-af52196a274d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1407 microversion: 2.20 time: 1.859010 Sep 11 00:56:15.954947 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 13/31] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:56:14 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1407 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:56:15.960299 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a1098b08-0e0a-4977-b401-9ce4c6a5f365 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:15.976179 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a1098b08-0e0a-4977-b401-9ce4c6a5f365 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:15.995575 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1098b08-0e0a-4977-b401-9ce4c6a5f365 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:15.996290 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1098b08-0e0a-4977-b401-9ce4c6a5f365 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:16.003315 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1098b08-0e0a-4977-b401-9ce4c6a5f365 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:16.004080 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1098b08-0e0a-4977-b401-9ce4c6a5f365 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:16.004703 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1098b08-0e0a-4977-b401-9ce4c6a5f365 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:16.005275 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1098b08-0e0a-4977-b401-9ce4c6a5f365 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:16.147743 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b4cb8aaa-6c79-460f-91e0-81836f9b196d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:16.163939 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b4cb8aaa-6c79-460f-91e0-81836f9b196d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1297 microversion: 2.1 time: 0.444553 Sep 11 00:56:16.168012 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 19/32] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:15 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1297 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:16.422773 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0f45945b-81b6-4964-ad2c-2c971c952bc0 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:16.423917 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0f45945b-81b6-4964-ad2c-2c971c952bc0 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:16.459940 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f45945b-81b6-4964-ad2c-2c971c952bc0 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:16.466397 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f45945b-81b6-4964-ad2c-2c971c952bc0 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:16.467895 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f45945b-81b6-4964-ad2c-2c971c952bc0 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:16.470543 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f45945b-81b6-4964-ad2c-2c971c952bc0 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:16.476118 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f45945b-81b6-4964-ad2c-2c971c952bc0 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:16.476839 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f45945b-81b6-4964-ad2c-2c971c952bc0 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:17.518502 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a1098b08-0e0a-4977-b401-9ce4c6a5f365 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:17.540807 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a1098b08-0e0a-4977-b401-9ce4c6a5f365 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 1.581970 Sep 11 00:56:17.543009 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 14/33] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:15 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:17.577461 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5c349705-d6eb-4606-8e81-227d666f4493 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:17.585362 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-5c349705-d6eb-4606-8e81-227d666f4493 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:17.615939 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5c349705-d6eb-4606-8e81-227d666f4493 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:17.616759 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5c349705-d6eb-4606-8e81-227d666f4493 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:17.617463 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5c349705-d6eb-4606-8e81-227d666f4493 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:17.622574 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5c349705-d6eb-4606-8e81-227d666f4493 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:17.624909 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5c349705-d6eb-4606-8e81-227d666f4493 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:17.628757 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5c349705-d6eb-4606-8e81-227d666f4493 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:17.714860 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=6 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:17.864090 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=24 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:17.979575 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-5c349705-d6eb-4606-8e81-227d666f4493 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:17.993445 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-5c349705-d6eb-4606-8e81-227d666f4493 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1279 microversion: 2.1 time: 0.444867 Sep 11 00:56:17.994465 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 15/34] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:17 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1279 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:18.000629 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-75c0c3d9-a1d8-445b-9b56-a29470aba12b req-dd68a2e0-6cea-4161-b52d-e1f901abcc77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "185afbdf-74f7-4a54-8ba8-58e7b6fd2e73", "tag": "903eede7-b91a-4899-9cea-f0ba8d7eea74"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:18.015416 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-75c0c3d9-a1d8-445b-9b56-a29470aba12b req-dd68a2e0-6cea-4161-b52d-e1f901abcc77 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:18.015907 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-75c0c3d9-a1d8-445b-9b56-a29470aba12b req-dd68a2e0-6cea-4161-b52d-e1f901abcc77 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:18.016333 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-75c0c3d9-a1d8-445b-9b56-a29470aba12b req-dd68a2e0-6cea-4161-b52d-e1f901abcc77 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:18.028114 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-75c0c3d9-a1d8-445b-9b56-a29470aba12b req-dd68a2e0-6cea-4161-b52d-e1f901abcc77 service nova] Creating event network-changed:903eede7-b91a-4899-9cea-f0ba8d7eea74 for instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 on hv-cinder-maste Sep 11 00:56:18.033416 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-75c0c3d9-a1d8-445b-9b56-a29470aba12b req-dd68a2e0-6cea-4161-b52d-e1f901abcc77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037684 Sep 11 00:56:18.035054 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 16/35] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:56:18.040813 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-14c6645d-86aa-41fc-aa3c-05c7016d5ad7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:18.041537 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-14c6645d-86aa-41fc-aa3c-05c7016d5ad7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:18.048818 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-14c6645d-86aa-41fc-aa3c-05c7016d5ad7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:18.049301 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-14c6645d-86aa-41fc-aa3c-05c7016d5ad7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:18.049737 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-14c6645d-86aa-41fc-aa3c-05c7016d5ad7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:18.050436 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-14c6645d-86aa-41fc-aa3c-05c7016d5ad7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:18.050879 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-14c6645d-86aa-41fc-aa3c-05c7016d5ad7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:18.051497 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-14c6645d-86aa-41fc-aa3c-05c7016d5ad7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:18.409771 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0f45945b-81b6-4964-ad2c-2c971c952bc0 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:18.412523 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=77 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:18.420167 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0f45945b-81b6-4964-ad2c-2c971c952bc0 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1315 microversion: 2.1 time: 2.006994 Sep 11 00:56:18.423274 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 20/36] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:16 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1315 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:18.430838 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f7e4a061-f06f-47c6-8a78-c3a9502eb5d6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:18.431927 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f7e4a061-f06f-47c6-8a78-c3a9502eb5d6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:18.442556 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:18.444657 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f7e4a061-f06f-47c6-8a78-c3a9502eb5d6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:18.450263 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f7e4a061-f06f-47c6-8a78-c3a9502eb5d6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:18.450795 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f7e4a061-f06f-47c6-8a78-c3a9502eb5d6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:18.451684 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f7e4a061-f06f-47c6-8a78-c3a9502eb5d6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:18.452493 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f7e4a061-f06f-47c6-8a78-c3a9502eb5d6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:18.453015 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f7e4a061-f06f-47c6-8a78-c3a9502eb5d6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:19.291912 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-14c6645d-86aa-41fc-aa3c-05c7016d5ad7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:19.306245 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-14c6645d-86aa-41fc-aa3c-05c7016d5ad7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:19.307956 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-14c6645d-86aa-41fc-aa3c-05c7016d5ad7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:19.309574 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-14c6645d-86aa-41fc-aa3c-05c7016d5ad7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1407 microversion: 2.20 time: 1.273193 Sep 11 00:56:19.310354 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 17/37] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:56:18 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1407 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:56:19.316666 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e474f7f0-f419-456a-a8b2-757748376d41 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:19.317723 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-e474f7f0-f419-456a-a8b2-757748376d41 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:19.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e474f7f0-f419-456a-a8b2-757748376d41 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:19.333667 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e474f7f0-f419-456a-a8b2-757748376d41 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:19.335203 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e474f7f0-f419-456a-a8b2-757748376d41 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:19.336155 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e474f7f0-f419-456a-a8b2-757748376d41 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:19.336834 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e474f7f0-f419-456a-a8b2-757748376d41 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:19.337406 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e474f7f0-f419-456a-a8b2-757748376d41 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:19.566523 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f7e4a061-f06f-47c6-8a78-c3a9502eb5d6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:19.581705 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f7e4a061-f06f-47c6-8a78-c3a9502eb5d6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1364 microversion: 2.1 time: 1.157003 Sep 11 00:56:19.582290 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 21/38] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:18 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1364 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:19.587434 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2ffc3f97-37cb-4750-9fa8-89318d3ccd99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:19.590629 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2ffc3f97-37cb-4750-9fa8-89318d3ccd99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:19.605380 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2ffc3f97-37cb-4750-9fa8-89318d3ccd99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:19.606164 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2ffc3f97-37cb-4750-9fa8-89318d3ccd99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:19.606828 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2ffc3f97-37cb-4750-9fa8-89318d3ccd99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:19.607920 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2ffc3f97-37cb-4750-9fa8-89318d3ccd99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:19.608621 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2ffc3f97-37cb-4750-9fa8-89318d3ccd99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:19.609234 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2ffc3f97-37cb-4750-9fa8-89318d3ccd99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:19.988937 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-e474f7f0-f419-456a-a8b2-757748376d41 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:20.000942 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-e474f7f0-f419-456a-a8b2-757748376d41 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 0.686497 Sep 11 00:56:20.001619 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 18/39] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:19 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:20.015864 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ed2043d1-dbcf-4954-aa21-cce28d76f2b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:20.016486 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ed2043d1-dbcf-4954-aa21-cce28d76f2b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:20.027336 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ed2043d1-dbcf-4954-aa21-cce28d76f2b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:20.027933 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ed2043d1-dbcf-4954-aa21-cce28d76f2b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:20.028367 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ed2043d1-dbcf-4954-aa21-cce28d76f2b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:20.029137 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ed2043d1-dbcf-4954-aa21-cce28d76f2b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:20.029587 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ed2043d1-dbcf-4954-aa21-cce28d76f2b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:20.030057 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ed2043d1-dbcf-4954-aa21-cce28d76f2b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:20.041016 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=26 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:20.254829 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-2ffc3f97-37cb-4750-9fa8-89318d3ccd99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:20.268162 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2ffc3f97-37cb-4750-9fa8-89318d3ccd99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1321 microversion: 2.1 time: 0.683388 Sep 11 00:56:20.269365 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 22/40] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:19 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1321 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:20.275204 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-ee265cb0-c709-44dc-b7f7-be38bfc9e39d req-05ecc797-f76b-404c-9d86-3c1a6a2d4131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5a68ae4-8f64-474d-aca7-974bd8fd266a", "tag": "45e6e7a2-cde7-4a70-8d40-d6a3344f9545"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:20.289358 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-ee265cb0-c709-44dc-b7f7-be38bfc9e39d req-05ecc797-f76b-404c-9d86-3c1a6a2d4131 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:20.290069 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-ee265cb0-c709-44dc-b7f7-be38bfc9e39d req-05ecc797-f76b-404c-9d86-3c1a6a2d4131 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:20.290649 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-ee265cb0-c709-44dc-b7f7-be38bfc9e39d req-05ecc797-f76b-404c-9d86-3c1a6a2d4131 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:20.319517 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-ee265cb0-c709-44dc-b7f7-be38bfc9e39d req-05ecc797-f76b-404c-9d86-3c1a6a2d4131 service nova] Creating event network-changed:45e6e7a2-cde7-4a70-8d40-d6a3344f9545 for instance a5a68ae4-8f64-474d-aca7-974bd8fd266a on hv-cinder-maste Sep 11 00:56:20.320499 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-ee265cb0-c709-44dc-b7f7-be38bfc9e39d req-05ecc797-f76b-404c-9d86-3c1a6a2d4131 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120496) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 11 00:56:20.321378 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-ee265cb0-c709-44dc-b7f7-be38bfc9e39d req-05ecc797-f76b-404c-9d86-3c1a6a2d4131 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120496) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 11 00:56:20.323564 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73fd2e26-ef6a-4e82-9b5a-b36627b32e1c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:20.324218 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73fd2e26-ef6a-4e82-9b5a-b36627b32e1c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:20.324955 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73fd2e26-ef6a-4e82-9b5a-b36627b32e1c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:20.325833 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73fd2e26-ef6a-4e82-9b5a-b36627b32e1c None None] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:20.326808 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73fd2e26-ef6a-4e82-9b5a-b36627b32e1c None None] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:20.329396 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73fd2e26-ef6a-4e82-9b5a-b36627b32e1c None None] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:20.342855 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.compute.rpcapi [None req-73fd2e26-ef6a-4e82-9b5a-b36627b32e1c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 11 00:56:20.346485 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73fd2e26-ef6a-4e82-9b5a-b36627b32e1c None None] Releasing lock "compute-rpcapi-router" {{(pid=120496) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 11 00:56:20.369520 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-73fd2e26-ef6a-4e82-9b5a-b36627b32e1c None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098256 Sep 11 00:56:20.370907 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 23/41] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:56:20.377095 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-55d9aeaa-f5a2-4ce2-af0e-616fc069ebd2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:20.378099 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-55d9aeaa-f5a2-4ce2-af0e-616fc069ebd2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:20.388182 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-55d9aeaa-f5a2-4ce2-af0e-616fc069ebd2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:20.388633 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-55d9aeaa-f5a2-4ce2-af0e-616fc069ebd2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:20.389201 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-55d9aeaa-f5a2-4ce2-af0e-616fc069ebd2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:20.390237 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-55d9aeaa-f5a2-4ce2-af0e-616fc069ebd2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:20.390870 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-55d9aeaa-f5a2-4ce2-af0e-616fc069ebd2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:20.391682 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-55d9aeaa-f5a2-4ce2-af0e-616fc069ebd2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:20.658424 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ed2043d1-dbcf-4954-aa21-cce28d76f2b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:20.670960 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ed2043d1-dbcf-4954-aa21-cce28d76f2b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1315 microversion: 2.1 time: 0.668225 Sep 11 00:56:20.672148 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 19/42] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:20 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:20.687077 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-2161f04f-05c5-4220-aa61-fe52c4eb727d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:20.688518 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-2161f04f-05c5-4220-aa61-fe52c4eb727d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:20.702455 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2161f04f-05c5-4220-aa61-fe52c4eb727d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:20.706165 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2161f04f-05c5-4220-aa61-fe52c4eb727d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:20.706848 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2161f04f-05c5-4220-aa61-fe52c4eb727d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:20.707672 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2161f04f-05c5-4220-aa61-fe52c4eb727d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:20.708197 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2161f04f-05c5-4220-aa61-fe52c4eb727d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:20.708686 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2161f04f-05c5-4220-aa61-fe52c4eb727d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:21.482295 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-55d9aeaa-f5a2-4ce2-af0e-616fc069ebd2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:21.497623 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-55d9aeaa-f5a2-4ce2-af0e-616fc069ebd2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:21.499808 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-55d9aeaa-f5a2-4ce2-af0e-616fc069ebd2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:21.503110 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-55d9aeaa-f5a2-4ce2-af0e-616fc069ebd2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1407 microversion: 2.20 time: 1.130528 Sep 11 00:56:21.504903 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 24/43] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:56:20 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1407 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:56:21.596070 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-2161f04f-05c5-4220-aa61-fe52c4eb727d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:21.605530 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-2161f04f-05c5-4220-aa61-fe52c4eb727d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1364 microversion: 2.1 time: 0.930132 Sep 11 00:56:21.606750 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 20/44] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:20 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1364 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:21.621876 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-08304395-be73-4171-86b5-483ed79eafcc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:21.622651 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-08304395-be73-4171-86b5-483ed79eafcc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:21.627508 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:21.635105 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08304395-be73-4171-86b5-483ed79eafcc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:21.636066 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08304395-be73-4171-86b5-483ed79eafcc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:21.637061 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08304395-be73-4171-86b5-483ed79eafcc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:21.638302 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08304395-be73-4171-86b5-483ed79eafcc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:21.638946 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08304395-be73-4171-86b5-483ed79eafcc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:21.639385 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08304395-be73-4171-86b5-483ed79eafcc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:21.819789 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-3263f3bf-e3f8-472f-a899-a66d4cf7da11 req-7aa4f5e4-af08-429e-95cd-9268d8dfe344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11702158-2435-4d46-9e27-7ff56d83bca8", "tag": "6083c5ea-ec25-4a93-b7ff-4971543ff629"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:21.829905 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3263f3bf-e3f8-472f-a899-a66d4cf7da11 req-7aa4f5e4-af08-429e-95cd-9268d8dfe344 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:21.830519 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3263f3bf-e3f8-472f-a899-a66d4cf7da11 req-7aa4f5e4-af08-429e-95cd-9268d8dfe344 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:21.831017 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3263f3bf-e3f8-472f-a899-a66d4cf7da11 req-7aa4f5e4-af08-429e-95cd-9268d8dfe344 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:21.849836 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-3263f3bf-e3f8-472f-a899-a66d4cf7da11 req-7aa4f5e4-af08-429e-95cd-9268d8dfe344 service nova] Creating event network-changed:6083c5ea-ec25-4a93-b7ff-4971543ff629 for instance 11702158-2435-4d46-9e27-7ff56d83bca8 on hv-cinder-maste Sep 11 00:56:21.856307 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-3263f3bf-e3f8-472f-a899-a66d4cf7da11 req-7aa4f5e4-af08-429e-95cd-9268d8dfe344 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348021 Sep 11 00:56:21.857401 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 25/45] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:56:21.865043 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ce5fc0ab-a75e-477f-84cf-28bbf679c64e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:21.866094 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ce5fc0ab-a75e-477f-84cf-28bbf679c64e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:21.875377 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce5fc0ab-a75e-477f-84cf-28bbf679c64e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:21.876287 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce5fc0ab-a75e-477f-84cf-28bbf679c64e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:21.876962 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce5fc0ab-a75e-477f-84cf-28bbf679c64e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:21.878041 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce5fc0ab-a75e-477f-84cf-28bbf679c64e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:21.878672 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce5fc0ab-a75e-477f-84cf-28bbf679c64e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:21.880320 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce5fc0ab-a75e-477f-84cf-28bbf679c64e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:21.944942 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-08304395-be73-4171-86b5-483ed79eafcc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:21.954864 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-08304395-be73-4171-86b5-483ed79eafcc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 0.346841 Sep 11 00:56:21.956054 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 21/46] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:21 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:21.960837 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-dede5e2a-0afe-4a3d-8041-411b5b5a52cf tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:21.962039 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-dede5e2a-0afe-4a3d-8041-411b5b5a52cf tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:21.969445 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dede5e2a-0afe-4a3d-8041-411b5b5a52cf tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:21.969990 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dede5e2a-0afe-4a3d-8041-411b5b5a52cf tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:21.970413 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dede5e2a-0afe-4a3d-8041-411b5b5a52cf tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:21.971205 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dede5e2a-0afe-4a3d-8041-411b5b5a52cf tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:21.972083 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dede5e2a-0afe-4a3d-8041-411b5b5a52cf tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:21.972592 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dede5e2a-0afe-4a3d-8041-411b5b5a52cf tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:22.185770 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-ce5fc0ab-a75e-477f-84cf-28bbf679c64e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:22.199358 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ce5fc0ab-a75e-477f-84cf-28bbf679c64e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1321 microversion: 2.1 time: 0.339938 Sep 11 00:56:22.200357 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 26/47] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:21 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:22.322409 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-dede5e2a-0afe-4a3d-8041-411b5b5a52cf tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:22.334726 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-dede5e2a-0afe-4a3d-8041-411b5b5a52cf tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1315 microversion: 2.1 time: 0.375424 Sep 11 00:56:22.348478 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 22/48] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:21 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:22.531169 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-29145cbd-46fa-497d-b32a-6e4d92cf7dff tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:22.533406 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-29145cbd-46fa-497d-b32a-6e4d92cf7dff tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:22.543498 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29145cbd-46fa-497d-b32a-6e4d92cf7dff tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:22.544427 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29145cbd-46fa-497d-b32a-6e4d92cf7dff tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:22.545593 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29145cbd-46fa-497d-b32a-6e4d92cf7dff tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:22.550048 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29145cbd-46fa-497d-b32a-6e4d92cf7dff tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:22.550983 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29145cbd-46fa-497d-b32a-6e4d92cf7dff tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:22.551769 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29145cbd-46fa-497d-b32a-6e4d92cf7dff tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:22.631502 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-7de51f1e-9f23-4865-8595-87da24313b2f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:22.632958 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-7de51f1e-9f23-4865-8595-87da24313b2f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:22.647595 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7de51f1e-9f23-4865-8595-87da24313b2f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:22.648350 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7de51f1e-9f23-4865-8595-87da24313b2f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:22.648965 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7de51f1e-9f23-4865-8595-87da24313b2f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:22.650925 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7de51f1e-9f23-4865-8595-87da24313b2f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:22.653241 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7de51f1e-9f23-4865-8595-87da24313b2f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:22.654371 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7de51f1e-9f23-4865-8595-87da24313b2f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:22.796825 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-29145cbd-46fa-497d-b32a-6e4d92cf7dff tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:22.805226 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-29145cbd-46fa-497d-b32a-6e4d92cf7dff tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:22.806697 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-29145cbd-46fa-497d-b32a-6e4d92cf7dff tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:22.807855 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-29145cbd-46fa-497d-b32a-6e4d92cf7dff tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1407 microversion: 2.20 time: 0.281500 Sep 11 00:56:22.825952 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 27/49] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:56:22 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:56:22.881167 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-7de51f1e-9f23-4865-8595-87da24313b2f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:22.892238 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-7de51f1e-9f23-4865-8595-87da24313b2f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1364 microversion: 2.1 time: 0.267097 Sep 11 00:56:22.893076 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 23/50] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:22 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:56:22.978529 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0442c05c-0ee0-4ebd-8c65-f780680b8c12 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:22.979136 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0442c05c-0ee0-4ebd-8c65-f780680b8c12 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:22.985836 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0442c05c-0ee0-4ebd-8c65-f780680b8c12 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:22.986312 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0442c05c-0ee0-4ebd-8c65-f780680b8c12 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:22.986736 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0442c05c-0ee0-4ebd-8c65-f780680b8c12 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:22.988050 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0442c05c-0ee0-4ebd-8c65-f780680b8c12 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:22.988473 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0442c05c-0ee0-4ebd-8c65-f780680b8c12 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:22.988963 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0442c05c-0ee0-4ebd-8c65-f780680b8c12 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:23.155237 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0442c05c-0ee0-4ebd-8c65-f780680b8c12 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:23.167211 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0442c05c-0ee0-4ebd-8c65-f780680b8c12 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 0.193028 Sep 11 00:56:23.168281 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 28/51] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:22 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:23.224151 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-34e3a629-785e-4aa3-8c32-a7054eb71bba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:23.225774 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-34e3a629-785e-4aa3-8c32-a7054eb71bba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:23.233742 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-34e3a629-785e-4aa3-8c32-a7054eb71bba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:23.234463 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-34e3a629-785e-4aa3-8c32-a7054eb71bba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:23.236427 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-34e3a629-785e-4aa3-8c32-a7054eb71bba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:23.238227 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-34e3a629-785e-4aa3-8c32-a7054eb71bba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:23.238804 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-34e3a629-785e-4aa3-8c32-a7054eb71bba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:23.240115 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-34e3a629-785e-4aa3-8c32-a7054eb71bba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:23.368013 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-cb58dbb8-ff49-4c63-8575-bf879f55a27f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:23.368849 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-cb58dbb8-ff49-4c63-8575-bf879f55a27f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:23.380279 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cb58dbb8-ff49-4c63-8575-bf879f55a27f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:23.381002 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cb58dbb8-ff49-4c63-8575-bf879f55a27f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:23.385540 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cb58dbb8-ff49-4c63-8575-bf879f55a27f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:23.386468 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cb58dbb8-ff49-4c63-8575-bf879f55a27f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:23.387087 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cb58dbb8-ff49-4c63-8575-bf879f55a27f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:23.389398 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cb58dbb8-ff49-4c63-8575-bf879f55a27f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:24.036098 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=8 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:24.130546 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-34e3a629-785e-4aa3-8c32-a7054eb71bba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:24.133086 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=95 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:24.165986 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-34e3a629-785e-4aa3-8c32-a7054eb71bba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1321 microversion: 2.1 time: 0.945906 Sep 11 00:56:24.175129 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 24/52] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:23 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1321 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:24.187059 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0e2ce74c-9750-49fc-87c5-9e18a042f52c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:24.192082 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-0e2ce74c-9750-49fc-87c5-9e18a042f52c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:24.218067 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e2ce74c-9750-49fc-87c5-9e18a042f52c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:24.221067 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e2ce74c-9750-49fc-87c5-9e18a042f52c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:24.221556 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e2ce74c-9750-49fc-87c5-9e18a042f52c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:24.225960 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e2ce74c-9750-49fc-87c5-9e18a042f52c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:24.226556 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e2ce74c-9750-49fc-87c5-9e18a042f52c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:24.226862 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e2ce74c-9750-49fc-87c5-9e18a042f52c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:24.825914 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-cb58dbb8-ff49-4c63-8575-bf879f55a27f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:24.829545 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0e2ce74c-9750-49fc-87c5-9e18a042f52c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:24.838769 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-cb58dbb8-ff49-4c63-8575-bf879f55a27f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1315 microversion: 2.1 time: 1.482296 Sep 11 00:56:24.840591 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 29/53] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:23 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1315 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:24.846052 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-445e8f34-b17c-4a73-bab2-67f48fbfe8bc tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:24.846668 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-445e8f34-b17c-4a73-bab2-67f48fbfe8bc tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:24.852526 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-445e8f34-b17c-4a73-bab2-67f48fbfe8bc tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:24.853267 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-445e8f34-b17c-4a73-bab2-67f48fbfe8bc tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:24.853939 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-445e8f34-b17c-4a73-bab2-67f48fbfe8bc tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:24.854601 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-445e8f34-b17c-4a73-bab2-67f48fbfe8bc tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:24.855250 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-445e8f34-b17c-4a73-bab2-67f48fbfe8bc tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:24.855817 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-445e8f34-b17c-4a73-bab2-67f48fbfe8bc tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:24.857168 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0e2ce74c-9750-49fc-87c5-9e18a042f52c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:24.859475 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0e2ce74c-9750-49fc-87c5-9e18a042f52c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:24.862330 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0e2ce74c-9750-49fc-87c5-9e18a042f52c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1407 microversion: 2.20 time: 0.682969 Sep 11 00:56:24.862906 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 25/54] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:56:24 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1407 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:56:24.867703 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-f80f820f-0a5b-4280-ae4f-9bc5863d1ed3 req-1c591c91-96a5-43b0-97d7-effbf8bedc1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee33cc4-87a0-41a6-8838-5feba8a3a9bd", "tag": "d0e5f32c-3edd-4dad-89f8-2185777781b5"}, {"name": "network-changed", "server_uuid": "67923a02-d1a5-4177-b7f3-15e4e795894a", "tag": "56083e81-21bc-4e71-a9e4-4346256d398e"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:24.880265 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-f80f820f-0a5b-4280-ae4f-9bc5863d1ed3 req-1c591c91-96a5-43b0-97d7-effbf8bedc1b service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:24.880908 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-f80f820f-0a5b-4280-ae4f-9bc5863d1ed3 req-1c591c91-96a5-43b0-97d7-effbf8bedc1b service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:24.881338 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-f80f820f-0a5b-4280-ae4f-9bc5863d1ed3 req-1c591c91-96a5-43b0-97d7-effbf8bedc1b service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:24.894812 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-f80f820f-0a5b-4280-ae4f-9bc5863d1ed3 req-1c591c91-96a5-43b0-97d7-effbf8bedc1b service nova] Creating event network-changed:d0e5f32c-3edd-4dad-89f8-2185777781b5 for instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd on hv-cinder-maste Sep 11 00:56:24.895410 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-f80f820f-0a5b-4280-ae4f-9bc5863d1ed3 req-1c591c91-96a5-43b0-97d7-effbf8bedc1b service nova] Creating event network-changed:56083e81-21bc-4e71-a9e4-4346256d398e for instance 67923a02-d1a5-4177-b7f3-15e4e795894a on hv-cinder-maste Sep 11 00:56:24.903351 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-f80f820f-0a5b-4280-ae4f-9bc5863d1ed3 req-1c591c91-96a5-43b0-97d7-effbf8bedc1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039063 Sep 11 00:56:24.904510 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 26/55] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:56:24.911254 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-af532cde-18a3-4b52-a042-83089ad546f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:24.912756 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-af532cde-18a3-4b52-a042-83089ad546f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:24.921123 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af532cde-18a3-4b52-a042-83089ad546f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:24.921825 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af532cde-18a3-4b52-a042-83089ad546f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:24.922429 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af532cde-18a3-4b52-a042-83089ad546f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:24.923658 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af532cde-18a3-4b52-a042-83089ad546f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:24.924293 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af532cde-18a3-4b52-a042-83089ad546f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:24.924873 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af532cde-18a3-4b52-a042-83089ad546f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:25.122861 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-445e8f34-b17c-4a73-bab2-67f48fbfe8bc tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:25.129959 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-af532cde-18a3-4b52-a042-83089ad546f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:25.143994 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-445e8f34-b17c-4a73-bab2-67f48fbfe8bc tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1364 microversion: 2.1 time: 0.299076 Sep 11 00:56:25.147156 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 30/56] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:24 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1364 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:25.152176 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-af532cde-18a3-4b52-a042-83089ad546f9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 0.245372 Sep 11 00:56:25.172498 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 27/57] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:24 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:25.201949 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-32c91823-dc07-4f3a-886d-e9878a45ec7d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:25.202708 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-32c91823-dc07-4f3a-886d-e9878a45ec7d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:25.212612 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32c91823-dc07-4f3a-886d-e9878a45ec7d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:25.216292 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32c91823-dc07-4f3a-886d-e9878a45ec7d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:25.217059 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32c91823-dc07-4f3a-886d-e9878a45ec7d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:25.218016 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32c91823-dc07-4f3a-886d-e9878a45ec7d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:25.219057 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32c91823-dc07-4f3a-886d-e9878a45ec7d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:25.222032 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32c91823-dc07-4f3a-886d-e9878a45ec7d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:25.440458 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-32c91823-dc07-4f3a-886d-e9878a45ec7d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:25.453354 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-32c91823-dc07-4f3a-886d-e9878a45ec7d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1321 microversion: 2.1 time: 0.255402 Sep 11 00:56:25.454566 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 31/58] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:25 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:25.863333 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a3124543-5d6b-4566-9a7e-8c3130485c3d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:25.864113 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a3124543-5d6b-4566-9a7e-8c3130485c3d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:25.873575 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a3124543-5d6b-4566-9a7e-8c3130485c3d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:25.874656 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a3124543-5d6b-4566-9a7e-8c3130485c3d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:25.875134 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a3124543-5d6b-4566-9a7e-8c3130485c3d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:25.877709 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a3124543-5d6b-4566-9a7e-8c3130485c3d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:25.878488 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a3124543-5d6b-4566-9a7e-8c3130485c3d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:25.880094 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a3124543-5d6b-4566-9a7e-8c3130485c3d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:25.887592 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ac73d06a-ed45-4172-8a28-e48e547c24cc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:25.888780 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ac73d06a-ed45-4172-8a28-e48e547c24cc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:25.899220 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac73d06a-ed45-4172-8a28-e48e547c24cc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:25.901419 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac73d06a-ed45-4172-8a28-e48e547c24cc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:25.903095 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac73d06a-ed45-4172-8a28-e48e547c24cc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:25.903992 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac73d06a-ed45-4172-8a28-e48e547c24cc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:25.905253 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac73d06a-ed45-4172-8a28-e48e547c24cc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:25.906029 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac73d06a-ed45-4172-8a28-e48e547c24cc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:26.171932 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a3124543-5d6b-4566-9a7e-8c3130485c3d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:26.189297 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a3124543-5d6b-4566-9a7e-8c3130485c3d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1315 microversion: 2.1 time: 0.330856 Sep 11 00:56:26.195414 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 28/59] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:25 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:26.204551 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f3dbf0be-174b-42c7-b551-f0e668783796 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:26.206619 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f3dbf0be-174b-42c7-b551-f0e668783796 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:26.210624 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-ac73d06a-ed45-4172-8a28-e48e547c24cc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:26.221272 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f3dbf0be-174b-42c7-b551-f0e668783796 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:26.221998 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f3dbf0be-174b-42c7-b551-f0e668783796 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:26.222588 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f3dbf0be-174b-42c7-b551-f0e668783796 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:26.222810 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-ac73d06a-ed45-4172-8a28-e48e547c24cc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:26.223668 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f3dbf0be-174b-42c7-b551-f0e668783796 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:26.224281 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f3dbf0be-174b-42c7-b551-f0e668783796 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:26.224397 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-ac73d06a-ed45-4172-8a28-e48e547c24cc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:26.225083 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f3dbf0be-174b-42c7-b551-f0e668783796 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:26.226703 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ac73d06a-ed45-4172-8a28-e48e547c24cc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1407 microversion: 2.20 time: 0.342166 Sep 11 00:56:26.231670 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 32/60] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:56:25 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:56:26.258942 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c831052a-bbcc-4db4-a7ca-1652a7d5704e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:26.261710 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c831052a-bbcc-4db4-a7ca-1652a7d5704e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:26.287724 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c831052a-bbcc-4db4-a7ca-1652a7d5704e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:26.288537 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c831052a-bbcc-4db4-a7ca-1652a7d5704e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:26.289009 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c831052a-bbcc-4db4-a7ca-1652a7d5704e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:26.293068 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c831052a-bbcc-4db4-a7ca-1652a7d5704e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:26.293627 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c831052a-bbcc-4db4-a7ca-1652a7d5704e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:26.294067 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c831052a-bbcc-4db4-a7ca-1652a7d5704e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:26.655265 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f3dbf0be-174b-42c7-b551-f0e668783796 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:26.670287 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f3dbf0be-174b-42c7-b551-f0e668783796 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1364 microversion: 2.1 time: 0.472424 Sep 11 00:56:26.672314 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 29/61] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:26 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1364 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:26.845160 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c831052a-bbcc-4db4-a7ca-1652a7d5704e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:26.853425 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c831052a-bbcc-4db4-a7ca-1652a7d5704e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 0.620666 Sep 11 00:56:26.857442 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 33/62] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:26 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:26.867452 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c2a94ab2-1594-491f-98fa-b0664c2eb1bd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:26.868080 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c2a94ab2-1594-491f-98fa-b0664c2eb1bd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:26.884687 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2a94ab2-1594-491f-98fa-b0664c2eb1bd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:26.885181 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2a94ab2-1594-491f-98fa-b0664c2eb1bd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:26.886289 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2a94ab2-1594-491f-98fa-b0664c2eb1bd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:26.887027 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2a94ab2-1594-491f-98fa-b0664c2eb1bd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:26.889948 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2a94ab2-1594-491f-98fa-b0664c2eb1bd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:26.890555 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2a94ab2-1594-491f-98fa-b0664c2eb1bd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:27.019698 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-824c330d-9b92-4f75-b037-0262c839397c req-b3ba3889-1bb9-4bf7-ab09-221d57baa4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda4760f-be50-4efe-808f-d4ab2c0358f4", "name": "network-vif-plugged", "status": "completed", "tag": "0a23eaa3-e9b6-4004-81da-c5fb16fac3ac"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:27.031870 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-824c330d-9b92-4f75-b037-0262c839397c req-b3ba3889-1bb9-4bf7-ab09-221d57baa4ba service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:27.032820 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-824c330d-9b92-4f75-b037-0262c839397c req-b3ba3889-1bb9-4bf7-ab09-221d57baa4ba service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:27.033706 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-824c330d-9b92-4f75-b037-0262c839397c req-b3ba3889-1bb9-4bf7-ab09-221d57baa4ba service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:27.050413 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-824c330d-9b92-4f75-b037-0262c839397c req-b3ba3889-1bb9-4bf7-ab09-221d57baa4ba service nova] Creating event network-vif-plugged:0a23eaa3-e9b6-4004-81da-c5fb16fac3ac for instance eda4760f-be50-4efe-808f-d4ab2c0358f4 on hv-cinder-maste Sep 11 00:56:27.057176 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-824c330d-9b92-4f75-b037-0262c839397c req-b3ba3889-1bb9-4bf7-ab09-221d57baa4ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.383251 Sep 11 00:56:27.058760 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 30/63] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:56:27.222394 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8d33509b-a426-45a0-aae1-4ef486fc3b1a tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:27.223460 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-8d33509b-a426-45a0-aae1-4ef486fc3b1a tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:27.238284 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8d33509b-a426-45a0-aae1-4ef486fc3b1a tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:27.238815 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8d33509b-a426-45a0-aae1-4ef486fc3b1a tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:27.239308 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8d33509b-a426-45a0-aae1-4ef486fc3b1a tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:27.243914 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8d33509b-a426-45a0-aae1-4ef486fc3b1a tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:27.245655 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8d33509b-a426-45a0-aae1-4ef486fc3b1a tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:27.246272 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8d33509b-a426-45a0-aae1-4ef486fc3b1a tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:27.686434 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c2a94ab2-1594-491f-98fa-b0664c2eb1bd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:27.697336 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c2a94ab2-1594-491f-98fa-b0664c2eb1bd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1321 microversion: 2.1 time: 0.838497 Sep 11 00:56:27.699228 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 34/64] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:26 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1321 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:27.734525 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b4d794c9-7b23-4910-b563-0ce307b364eb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:27.736394 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b4d794c9-7b23-4910-b563-0ce307b364eb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:27.753143 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4d794c9-7b23-4910-b563-0ce307b364eb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:27.754060 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4d794c9-7b23-4910-b563-0ce307b364eb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:27.754794 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4d794c9-7b23-4910-b563-0ce307b364eb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:27.755723 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4d794c9-7b23-4910-b563-0ce307b364eb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:27.756315 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4d794c9-7b23-4910-b563-0ce307b364eb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:27.757031 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4d794c9-7b23-4910-b563-0ce307b364eb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:27.798428 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8d33509b-a426-45a0-aae1-4ef486fc3b1a tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:27.808639 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8d33509b-a426-45a0-aae1-4ef486fc3b1a tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1315 microversion: 2.1 time: 0.592083 Sep 11 00:56:27.811890 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 31/65] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:27 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:27.821899 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-74aad61f-eb93-4da7-b1dc-e2c05cb2686a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:27.822851 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-74aad61f-eb93-4da7-b1dc-e2c05cb2686a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:27.844777 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-74aad61f-eb93-4da7-b1dc-e2c05cb2686a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:27.846954 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-74aad61f-eb93-4da7-b1dc-e2c05cb2686a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:27.847531 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-74aad61f-eb93-4da7-b1dc-e2c05cb2686a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:27.848538 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-74aad61f-eb93-4da7-b1dc-e2c05cb2686a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:27.849601 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-74aad61f-eb93-4da7-b1dc-e2c05cb2686a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:27.851662 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-74aad61f-eb93-4da7-b1dc-e2c05cb2686a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:28.232371 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-74aad61f-eb93-4da7-b1dc-e2c05cb2686a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:28.241985 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-74aad61f-eb93-4da7-b1dc-e2c05cb2686a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1364 microversion: 2.1 time: 0.427731 Sep 11 00:56:28.246227 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 32/66] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:27 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1364 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:28.257044 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ad026944-7008-4e97-aa34-2f7463252333 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:28.257814 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ad026944-7008-4e97-aa34-2f7463252333 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:28.277316 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ad026944-7008-4e97-aa34-2f7463252333 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:28.278200 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ad026944-7008-4e97-aa34-2f7463252333 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:28.278786 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ad026944-7008-4e97-aa34-2f7463252333 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:28.279660 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ad026944-7008-4e97-aa34-2f7463252333 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:28.280251 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ad026944-7008-4e97-aa34-2f7463252333 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:28.280951 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ad026944-7008-4e97-aa34-2f7463252333 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:28.446195 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b4d794c9-7b23-4910-b563-0ce307b364eb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:28.455116 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b4d794c9-7b23-4910-b563-0ce307b364eb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:28.457005 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b4d794c9-7b23-4910-b563-0ce307b364eb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:28.458466 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b4d794c9-7b23-4910-b563-0ce307b364eb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1407 microversion: 2.20 time: 0.758111 Sep 11 00:56:28.472206 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 35/67] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:56:27 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1407 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:56:28.623458 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ad026944-7008-4e97-aa34-2f7463252333 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:28.631735 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ad026944-7008-4e97-aa34-2f7463252333 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 0.384145 Sep 11 00:56:28.632567 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 33/68] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:28 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:28.722431 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0d1b40d7-6116-4983-826c-dcbb05a56ae6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:28.722990 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0d1b40d7-6116-4983-826c-dcbb05a56ae6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:28.728951 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d1b40d7-6116-4983-826c-dcbb05a56ae6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:28.729432 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d1b40d7-6116-4983-826c-dcbb05a56ae6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:28.730043 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d1b40d7-6116-4983-826c-dcbb05a56ae6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:28.730733 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d1b40d7-6116-4983-826c-dcbb05a56ae6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:28.731437 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d1b40d7-6116-4983-826c-dcbb05a56ae6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:28.731958 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d1b40d7-6116-4983-826c-dcbb05a56ae6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:28.838657 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3a0dbc53-f9ca-432d-930d-6d49428b9080 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:28.839293 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3a0dbc53-f9ca-432d-930d-6d49428b9080 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:28.847121 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3a0dbc53-f9ca-432d-930d-6d49428b9080 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:28.847842 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3a0dbc53-f9ca-432d-930d-6d49428b9080 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:28.848590 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3a0dbc53-f9ca-432d-930d-6d49428b9080 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:28.849483 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3a0dbc53-f9ca-432d-930d-6d49428b9080 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:28.850056 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3a0dbc53-f9ca-432d-930d-6d49428b9080 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:28.850595 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3a0dbc53-f9ca-432d-930d-6d49428b9080 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:28.990599 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0d1b40d7-6116-4983-826c-dcbb05a56ae6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:29.010518 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0d1b40d7-6116-4983-826c-dcbb05a56ae6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1321 microversion: 2.1 time: 0.284101 Sep 11 00:56:29.012473 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 36/69] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:28 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:29.078098 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-4a020753-c465-4755-b09d-d826536fe78b req-f295f8be-cc99-4bd8-8b4e-834c22edb3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185afbdf-74f7-4a54-8ba8-58e7b6fd2e73", "name": "network-vif-plugged", "status": "completed", "tag": "903eede7-b91a-4899-9cea-f0ba8d7eea74"}, {"server_uuid": "a5a68ae4-8f64-474d-aca7-974bd8fd266a", "name": "network-vif-plugged", "status": "completed", "tag": "45e6e7a2-cde7-4a70-8d40-d6a3344f9545"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:29.078323 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3a0dbc53-f9ca-432d-930d-6d49428b9080 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:29.087296 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3a0dbc53-f9ca-432d-930d-6d49428b9080 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1315 microversion: 2.1 time: 0.257171 Sep 11 00:56:29.088280 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 34/70] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:28 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:29.103943 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-4a020753-c465-4755-b09d-d826536fe78b req-f295f8be-cc99-4bd8-8b4e-834c22edb3ad service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:29.105090 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-4a020753-c465-4755-b09d-d826536fe78b req-f295f8be-cc99-4bd8-8b4e-834c22edb3ad service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:29.105829 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-4a020753-c465-4755-b09d-d826536fe78b req-f295f8be-cc99-4bd8-8b4e-834c22edb3ad service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:29.121057 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-4a020753-c465-4755-b09d-d826536fe78b req-f295f8be-cc99-4bd8-8b4e-834c22edb3ad service nova] Creating event network-vif-plugged:903eede7-b91a-4899-9cea-f0ba8d7eea74 for instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 on hv-cinder-maste Sep 11 00:56:29.121709 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-4a020753-c465-4755-b09d-d826536fe78b req-f295f8be-cc99-4bd8-8b4e-834c22edb3ad service nova] Creating event network-vif-plugged:45e6e7a2-cde7-4a70-8d40-d6a3344f9545 for instance a5a68ae4-8f64-474d-aca7-974bd8fd266a on hv-cinder-maste Sep 11 00:56:29.128344 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-4a020753-c465-4755-b09d-d826536fe78b req-f295f8be-cc99-4bd8-8b4e-834c22edb3ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055138 Sep 11 00:56:29.129221 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 37/71] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:56:29.272660 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-36f8a6e2-9fe5-42f1-9607-8a6a58ec73ab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:29.273354 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-36f8a6e2-9fe5-42f1-9607-8a6a58ec73ab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:29.281112 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36f8a6e2-9fe5-42f1-9607-8a6a58ec73ab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:29.281594 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36f8a6e2-9fe5-42f1-9607-8a6a58ec73ab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:29.282018 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36f8a6e2-9fe5-42f1-9607-8a6a58ec73ab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:29.283084 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36f8a6e2-9fe5-42f1-9607-8a6a58ec73ab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:29.283720 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36f8a6e2-9fe5-42f1-9607-8a6a58ec73ab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:29.284278 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36f8a6e2-9fe5-42f1-9607-8a6a58ec73ab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:29.486623 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-95648526-56ee-4327-8e3d-eeb749c6f30e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:29.496137 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-95648526-56ee-4327-8e3d-eeb749c6f30e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:29.517540 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95648526-56ee-4327-8e3d-eeb749c6f30e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:29.519470 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95648526-56ee-4327-8e3d-eeb749c6f30e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:29.522575 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95648526-56ee-4327-8e3d-eeb749c6f30e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:29.523878 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95648526-56ee-4327-8e3d-eeb749c6f30e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:29.524348 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95648526-56ee-4327-8e3d-eeb749c6f30e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:29.524800 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95648526-56ee-4327-8e3d-eeb749c6f30e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:29.553916 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-36f8a6e2-9fe5-42f1-9607-8a6a58ec73ab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:29.591491 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-36f8a6e2-9fe5-42f1-9607-8a6a58ec73ab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1364 microversion: 2.1 time: 0.310937 Sep 11 00:56:29.596916 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 35/72] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:29 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:29.671193 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6521e24d-9f6f-41b9-afd6-9fc182413a6d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:29.672091 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6521e24d-9f6f-41b9-afd6-9fc182413a6d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:29.681552 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6521e24d-9f6f-41b9-afd6-9fc182413a6d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:29.682383 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6521e24d-9f6f-41b9-afd6-9fc182413a6d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:29.683041 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6521e24d-9f6f-41b9-afd6-9fc182413a6d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:29.683989 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6521e24d-9f6f-41b9-afd6-9fc182413a6d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:29.684633 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6521e24d-9f6f-41b9-afd6-9fc182413a6d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:29.685262 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6521e24d-9f6f-41b9-afd6-9fc182413a6d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:30.127934 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-95648526-56ee-4327-8e3d-eeb749c6f30e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:30.137422 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-95648526-56ee-4327-8e3d-eeb749c6f30e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:30.139453 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-95648526-56ee-4327-8e3d-eeb749c6f30e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:30.146991 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6521e24d-9f6f-41b9-afd6-9fc182413a6d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:30.147580 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-95648526-56ee-4327-8e3d-eeb749c6f30e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1407 microversion: 2.20 time: 0.665072 Sep 11 00:56:30.148604 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 38/73] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:56:29 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1407 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:56:30.161292 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0ade4a3c-10af-4ba7-963f-dd7e8a74b8ff tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:30.162047 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0ade4a3c-10af-4ba7-963f-dd7e8a74b8ff tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:30.173233 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0ade4a3c-10af-4ba7-963f-dd7e8a74b8ff tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:30.173233 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0ade4a3c-10af-4ba7-963f-dd7e8a74b8ff tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:30.173233 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0ade4a3c-10af-4ba7-963f-dd7e8a74b8ff tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:30.173233 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0ade4a3c-10af-4ba7-963f-dd7e8a74b8ff tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:30.173944 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0ade4a3c-10af-4ba7-963f-dd7e8a74b8ff tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:30.174023 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6521e24d-9f6f-41b9-afd6-9fc182413a6d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 0.518721 Sep 11 00:56:30.174111 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0ade4a3c-10af-4ba7-963f-dd7e8a74b8ff tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:30.175595 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:30.184504 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 36/74] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:29 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:30.194296 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-27fb50ae-6557-455f-bf63-6707900e0304 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:30.194917 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-27fb50ae-6557-455f-bf63-6707900e0304 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:30.200825 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-27fb50ae-6557-455f-bf63-6707900e0304 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:30.201309 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-27fb50ae-6557-455f-bf63-6707900e0304 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:30.201729 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-27fb50ae-6557-455f-bf63-6707900e0304 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:30.202419 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-27fb50ae-6557-455f-bf63-6707900e0304 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:30.202861 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-27fb50ae-6557-455f-bf63-6707900e0304 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:30.203317 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-27fb50ae-6557-455f-bf63-6707900e0304 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:30.339527 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:30.394104 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0ade4a3c-10af-4ba7-963f-dd7e8a74b8ff tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:30.398242 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-27fb50ae-6557-455f-bf63-6707900e0304 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:30.404343 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0ade4a3c-10af-4ba7-963f-dd7e8a74b8ff tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1321 microversion: 2.1 time: 0.253941 Sep 11 00:56:30.405351 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 39/75] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:30 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:30.406618 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-27fb50ae-6557-455f-bf63-6707900e0304 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1315 microversion: 2.1 time: 0.220968 Sep 11 00:56:30.407453 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 37/76] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:30 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:30.624000 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-cd82f999-f368-4b29-bca1-634f013b64b2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:30.624620 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-cd82f999-f368-4b29-bca1-634f013b64b2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:30.631229 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cd82f999-f368-4b29-bca1-634f013b64b2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:30.631797 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cd82f999-f368-4b29-bca1-634f013b64b2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:30.632330 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cd82f999-f368-4b29-bca1-634f013b64b2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:30.633029 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cd82f999-f368-4b29-bca1-634f013b64b2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:30.633474 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cd82f999-f368-4b29-bca1-634f013b64b2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:30.634048 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cd82f999-f368-4b29-bca1-634f013b64b2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:30.778339 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-cd82f999-f368-4b29-bca1-634f013b64b2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:30.787088 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-cd82f999-f368-4b29-bca1-634f013b64b2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1364 microversion: 2.1 time: 0.171359 Sep 11 00:56:30.787624 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 40/77] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:30 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:31.183033 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-779bef6e-af74-47d7-87c6-818785235e42 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:31.184452 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-779bef6e-af74-47d7-87c6-818785235e42 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:31.192663 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-779bef6e-af74-47d7-87c6-818785235e42 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:31.193216 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-779bef6e-af74-47d7-87c6-818785235e42 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:31.194071 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-779bef6e-af74-47d7-87c6-818785235e42 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:31.195150 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-779bef6e-af74-47d7-87c6-818785235e42 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:31.195998 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-779bef6e-af74-47d7-87c6-818785235e42 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:31.196675 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-779bef6e-af74-47d7-87c6-818785235e42 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:31.204279 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f66f8b2b-db37-4f3f-9d19-74ecb77bd452 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:31.204903 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f66f8b2b-db37-4f3f-9d19-74ecb77bd452 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:31.212309 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f66f8b2b-db37-4f3f-9d19-74ecb77bd452 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:31.213000 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f66f8b2b-db37-4f3f-9d19-74ecb77bd452 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:31.213834 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f66f8b2b-db37-4f3f-9d19-74ecb77bd452 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:31.214785 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f66f8b2b-db37-4f3f-9d19-74ecb77bd452 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:31.215592 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f66f8b2b-db37-4f3f-9d19-74ecb77bd452 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:31.216223 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f66f8b2b-db37-4f3f-9d19-74ecb77bd452 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:31.435012 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-779bef6e-af74-47d7-87c6-818785235e42 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:31.437647 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f66f8b2b-db37-4f3f-9d19-74ecb77bd452 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:31.444263 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-779bef6e-af74-47d7-87c6-818785235e42 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:31.446181 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-779bef6e-af74-47d7-87c6-818785235e42 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:31.447534 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-779bef6e-af74-47d7-87c6-818785235e42 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1407 microversion: 2.20 time: 0.275511 Sep 11 00:56:31.447779 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f66f8b2b-db37-4f3f-9d19-74ecb77bd452 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 0.247275 Sep 11 00:56:31.448625 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 38/78] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:56:31 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:56:31.450693 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 41/79] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:31 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:56:31.454945 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6cadf25f-de1d-463d-827e-6b53580e711d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:31.455575 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6cadf25f-de1d-463d-827e-6b53580e711d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:31.468964 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6f8e3d74-0850-41bc-880d-2d49644dafc3 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:31.469871 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6f8e3d74-0850-41bc-880d-2d49644dafc3 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:31.470131 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6cadf25f-de1d-463d-827e-6b53580e711d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:31.470832 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6cadf25f-de1d-463d-827e-6b53580e711d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:31.473429 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6cadf25f-de1d-463d-827e-6b53580e711d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:31.474163 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6cadf25f-de1d-463d-827e-6b53580e711d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:31.474621 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6cadf25f-de1d-463d-827e-6b53580e711d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:31.475054 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6cadf25f-de1d-463d-827e-6b53580e711d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:31.477526 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f8e3d74-0850-41bc-880d-2d49644dafc3 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:31.477710 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f8e3d74-0850-41bc-880d-2d49644dafc3 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:31.478591 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f8e3d74-0850-41bc-880d-2d49644dafc3 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:31.479618 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f8e3d74-0850-41bc-880d-2d49644dafc3 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:31.480478 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f8e3d74-0850-41bc-880d-2d49644dafc3 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:31.481419 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f8e3d74-0850-41bc-880d-2d49644dafc3 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:31.738419 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6cadf25f-de1d-463d-827e-6b53580e711d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:31.752221 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6cadf25f-de1d-463d-827e-6b53580e711d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1321 microversion: 2.1 time: 0.302122 Sep 11 00:56:31.752810 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 39/80] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:31 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:31.766804 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6f8e3d74-0850-41bc-880d-2d49644dafc3 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:31.775264 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6f8e3d74-0850-41bc-880d-2d49644dafc3 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1315 microversion: 2.1 time: 0.323249 Sep 11 00:56:31.775840 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 42/81] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:31 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:31.814846 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e0cc2c32-f3e7-46e6-aeee-a84b0265dc18 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:31.815546 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-e0cc2c32-f3e7-46e6-aeee-a84b0265dc18 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:31.826545 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e0cc2c32-f3e7-46e6-aeee-a84b0265dc18 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:31.827744 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e0cc2c32-f3e7-46e6-aeee-a84b0265dc18 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:31.828470 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e0cc2c32-f3e7-46e6-aeee-a84b0265dc18 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:31.829230 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e0cc2c32-f3e7-46e6-aeee-a84b0265dc18 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:31.829981 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e0cc2c32-f3e7-46e6-aeee-a84b0265dc18 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:31.830366 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e0cc2c32-f3e7-46e6-aeee-a84b0265dc18 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:31.998540 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-e0cc2c32-f3e7-46e6-aeee-a84b0265dc18 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:32.013202 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-e0cc2c32-f3e7-46e6-aeee-a84b0265dc18 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1364 microversion: 2.1 time: 0.203836 Sep 11 00:56:32.013785 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 40/82] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:31 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:32.234814 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-4d4769ec-0e5d-4cb9-88d3-930bb6e8dcc5 req-65294a09-63ef-4a26-9b4b-8915d21d9cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee33cc4-87a0-41a6-8838-5feba8a3a9bd", "name": "network-vif-plugged", "status": "completed", "tag": "d0e5f32c-3edd-4dad-89f8-2185777781b5"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:32.255456 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-4d4769ec-0e5d-4cb9-88d3-930bb6e8dcc5 req-65294a09-63ef-4a26-9b4b-8915d21d9cef service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:32.255456 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-4d4769ec-0e5d-4cb9-88d3-930bb6e8dcc5 req-65294a09-63ef-4a26-9b4b-8915d21d9cef service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:32.255456 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-4d4769ec-0e5d-4cb9-88d3-930bb6e8dcc5 req-65294a09-63ef-4a26-9b4b-8915d21d9cef service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:32.273642 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-4d4769ec-0e5d-4cb9-88d3-930bb6e8dcc5 req-65294a09-63ef-4a26-9b4b-8915d21d9cef service nova] Creating event network-vif-plugged:d0e5f32c-3edd-4dad-89f8-2185777781b5 for instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd on hv-cinder-maste Sep 11 00:56:32.282438 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-4d4769ec-0e5d-4cb9-88d3-930bb6e8dcc5 req-65294a09-63ef-4a26-9b4b-8915d21d9cef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051325 Sep 11 00:56:32.285218 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 43/83] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:56:32.473407 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3b49faba-8ff8-43e0-bac5-47d65e8d638f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:32.474004 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3b49faba-8ff8-43e0-bac5-47d65e8d638f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:32.480771 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-405478fd-e0d9-4e6a-9e4e-e16c83dfe25f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:32.481514 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-405478fd-e0d9-4e6a-9e4e-e16c83dfe25f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:32.491453 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b49faba-8ff8-43e0-bac5-47d65e8d638f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:32.492056 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-405478fd-e0d9-4e6a-9e4e-e16c83dfe25f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:32.492183 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b49faba-8ff8-43e0-bac5-47d65e8d638f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:32.492500 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b49faba-8ff8-43e0-bac5-47d65e8d638f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:32.492625 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-405478fd-e0d9-4e6a-9e4e-e16c83dfe25f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:32.493481 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b49faba-8ff8-43e0-bac5-47d65e8d638f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:32.493617 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-405478fd-e0d9-4e6a-9e4e-e16c83dfe25f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:32.493905 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b49faba-8ff8-43e0-bac5-47d65e8d638f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:32.494355 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b49faba-8ff8-43e0-bac5-47d65e8d638f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:32.499198 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-405478fd-e0d9-4e6a-9e4e-e16c83dfe25f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:32.499670 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-405478fd-e0d9-4e6a-9e4e-e16c83dfe25f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:32.500106 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-405478fd-e0d9-4e6a-9e4e-e16c83dfe25f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:32.724065 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3b49faba-8ff8-43e0-bac5-47d65e8d638f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:32.744190 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3b49faba-8ff8-43e0-bac5-47d65e8d638f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:32.744541 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-405478fd-e0d9-4e6a-9e4e-e16c83dfe25f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:32.746122 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3b49faba-8ff8-43e0-bac5-47d65e8d638f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:32.747767 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3b49faba-8ff8-43e0-bac5-47d65e8d638f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1599 microversion: 2.20 time: 0.278235 Sep 11 00:56:32.749742 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 41/84] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:56:32 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1599 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:56:32.755321 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-405478fd-e0d9-4e6a-9e4e-e16c83dfe25f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 0.278632 Sep 11 00:56:32.757009 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 44/85] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:32 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:32.781197 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-26d334ff-ab20-4a1e-ac90-c14937f3615f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:32.781854 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-26d334ff-ab20-4a1e-ac90-c14937f3615f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:32.790452 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26d334ff-ab20-4a1e-ac90-c14937f3615f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:32.791042 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26d334ff-ab20-4a1e-ac90-c14937f3615f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:32.795256 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c4c61896-95ed-4417-a2d7-d76ce8ac7744 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:32.795885 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c4c61896-95ed-4417-a2d7-d76ce8ac7744 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:32.799047 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26d334ff-ab20-4a1e-ac90-c14937f3615f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:32.799838 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26d334ff-ab20-4a1e-ac90-c14937f3615f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:32.800442 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26d334ff-ab20-4a1e-ac90-c14937f3615f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:32.800897 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26d334ff-ab20-4a1e-ac90-c14937f3615f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:32.809728 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c4c61896-95ed-4417-a2d7-d76ce8ac7744 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:32.810225 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c4c61896-95ed-4417-a2d7-d76ce8ac7744 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:32.810663 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c4c61896-95ed-4417-a2d7-d76ce8ac7744 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:32.811409 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c4c61896-95ed-4417-a2d7-d76ce8ac7744 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:32.811859 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c4c61896-95ed-4417-a2d7-d76ce8ac7744 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:32.816099 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c4c61896-95ed-4417-a2d7-d76ce8ac7744 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:32.983725 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-26d334ff-ab20-4a1e-ac90-c14937f3615f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.208482 Sep 11 00:56:32.984328 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 45/86] 10.222.0.23 () {60 vars in 1316 bytes} [Sun Sep 11 00:56:32 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:56:32.989299 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-affa54c8-5e89-40ee-8ffa-2764b3e3ba24 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:32.989899 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-affa54c8-5e89-40ee-8ffa-2764b3e3ba24 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:33.015000 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-affa54c8-5e89-40ee-8ffa-2764b3e3ba24 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:33.015840 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-affa54c8-5e89-40ee-8ffa-2764b3e3ba24 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:33.018168 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-affa54c8-5e89-40ee-8ffa-2764b3e3ba24 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:33.019292 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-affa54c8-5e89-40ee-8ffa-2764b3e3ba24 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:33.019960 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-affa54c8-5e89-40ee-8ffa-2764b3e3ba24 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:33.020395 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-affa54c8-5e89-40ee-8ffa-2764b3e3ba24 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:33.036467 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c4c61896-95ed-4417-a2d7-d76ce8ac7744 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:33.039341 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=100 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:33.046944 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c4c61896-95ed-4417-a2d7-d76ce8ac7744 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1321 microversion: 2.1 time: 0.261091 Sep 11 00:56:33.062681 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 42/87] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:32 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:33.067516 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-75d9839b-df66-4814-822a-e95ea9c4c59b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:33.068343 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-75d9839b-df66-4814-822a-e95ea9c4c59b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:33.077455 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-75d9839b-df66-4814-822a-e95ea9c4c59b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:33.078466 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-75d9839b-df66-4814-822a-e95ea9c4c59b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:33.079106 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-75d9839b-df66-4814-822a-e95ea9c4c59b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:33.080012 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-75d9839b-df66-4814-822a-e95ea9c4c59b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:33.080605 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-75d9839b-df66-4814-822a-e95ea9c4c59b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:33.081176 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-75d9839b-df66-4814-822a-e95ea9c4c59b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:33.266573 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-affa54c8-5e89-40ee-8ffa-2764b3e3ba24 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:33.277498 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-affa54c8-5e89-40ee-8ffa-2764b3e3ba24 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1315 microversion: 2.1 time: 0.291649 Sep 11 00:56:33.292810 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 46/88] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:32 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:33.482170 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-75d9839b-df66-4814-822a-e95ea9c4c59b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:33.492382 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-75d9839b-df66-4814-822a-e95ea9c4c59b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1555 microversion: 2.1 time: 0.428536 Sep 11 00:56:33.493057 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 43/89] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:33 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1555 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:33.515731 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-663482d4-7171-4c59-88e7-135ba882a8c2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:33.516197 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-663482d4-7171-4c59-88e7-135ba882a8c2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:33.522474 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-663482d4-7171-4c59-88e7-135ba882a8c2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:33.522960 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-663482d4-7171-4c59-88e7-135ba882a8c2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:33.523607 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-663482d4-7171-4c59-88e7-135ba882a8c2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:33.524300 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-663482d4-7171-4c59-88e7-135ba882a8c2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:33.525059 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-663482d4-7171-4c59-88e7-135ba882a8c2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:33.525479 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-663482d4-7171-4c59-88e7-135ba882a8c2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:33.610863 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-663482d4-7171-4c59-88e7-135ba882a8c2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099115 Sep 11 00:56:33.611689 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 47/90] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Sep 11 00:56:33 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:56:33.786975 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-4c4520dc-5c3b-44f9-8031-777755f666a2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:33.789506 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-4c4520dc-5c3b-44f9-8031-777755f666a2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:33.805211 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4c4520dc-5c3b-44f9-8031-777755f666a2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:33.806310 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4c4520dc-5c3b-44f9-8031-777755f666a2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:33.808449 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4c4520dc-5c3b-44f9-8031-777755f666a2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:33.810037 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4c4520dc-5c3b-44f9-8031-777755f666a2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:33.811247 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4c4520dc-5c3b-44f9-8031-777755f666a2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:33.813007 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4c4520dc-5c3b-44f9-8031-777755f666a2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:34.070741 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7e52fd0f-5a83-4639-a7f3-d3ec85d574f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:34.072599 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7e52fd0f-5a83-4639-a7f3-d3ec85d574f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:34.079054 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e52fd0f-5a83-4639-a7f3-d3ec85d574f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:34.079804 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e52fd0f-5a83-4639-a7f3-d3ec85d574f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:34.080387 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e52fd0f-5a83-4639-a7f3-d3ec85d574f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:34.081242 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e52fd0f-5a83-4639-a7f3-d3ec85d574f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:34.081851 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e52fd0f-5a83-4639-a7f3-d3ec85d574f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:34.082580 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e52fd0f-5a83-4639-a7f3-d3ec85d574f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:34.237522 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-4c4520dc-5c3b-44f9-8031-777755f666a2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:34.249716 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-4c4520dc-5c3b-44f9-8031-777755f666a2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 0.468022 Sep 11 00:56:34.250319 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 44/91] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:33 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:34.303373 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-4df5c845-1049-40e9-bbf6-f840d5076c22 req-a1dc3e30-a934-4eac-84ac-bd072eb083ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67923a02-d1a5-4177-b7f3-15e4e795894a", "name": "network-vif-plugged", "status": "completed", "tag": "56083e81-21bc-4e71-a9e4-4346256d398e"}, {"server_uuid": "11702158-2435-4d46-9e27-7ff56d83bca8", "name": "network-vif-plugged", "status": "completed", "tag": "6083c5ea-ec25-4a93-b7ff-4971543ff629"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:34.323308 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-4df5c845-1049-40e9-bbf6-f840d5076c22 req-a1dc3e30-a934-4eac-84ac-bd072eb083ea service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:34.323943 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-4df5c845-1049-40e9-bbf6-f840d5076c22 req-a1dc3e30-a934-4eac-84ac-bd072eb083ea service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:34.324581 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-4df5c845-1049-40e9-bbf6-f840d5076c22 req-a1dc3e30-a934-4eac-84ac-bd072eb083ea service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:34.381545 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-4df5c845-1049-40e9-bbf6-f840d5076c22 req-a1dc3e30-a934-4eac-84ac-bd072eb083ea service nova] Creating event network-vif-plugged:56083e81-21bc-4e71-a9e4-4346256d398e for instance 67923a02-d1a5-4177-b7f3-15e4e795894a on hv-cinder-maste Sep 11 00:56:34.384170 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-4df5c845-1049-40e9-bbf6-f840d5076c22 req-a1dc3e30-a934-4eac-84ac-bd072eb083ea service nova] Creating event network-vif-plugged:6083c5ea-ec25-4a93-b7ff-4971543ff629 for instance 11702158-2435-4d46-9e27-7ff56d83bca8 on hv-cinder-maste Sep 11 00:56:34.429074 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-4df5c845-1049-40e9-bbf6-f840d5076c22 req-a1dc3e30-a934-4eac-84ac-bd072eb083ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.131452 Sep 11 00:56:34.431938 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 45/92] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:56:34.453261 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b7c4c8c4-27ca-4387-8279-31a3dff0fa65 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:34.454421 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-b7c4c8c4-27ca-4387-8279-31a3dff0fa65 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:34.471847 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b7c4c8c4-27ca-4387-8279-31a3dff0fa65 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:34.477833 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b7c4c8c4-27ca-4387-8279-31a3dff0fa65 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:34.478626 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b7c4c8c4-27ca-4387-8279-31a3dff0fa65 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:34.479675 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b7c4c8c4-27ca-4387-8279-31a3dff0fa65 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:34.482271 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b7c4c8c4-27ca-4387-8279-31a3dff0fa65 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:34.483469 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b7c4c8c4-27ca-4387-8279-31a3dff0fa65 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:34.548713 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-7e52fd0f-5a83-4639-a7f3-d3ec85d574f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:34.560776 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7e52fd0f-5a83-4639-a7f3-d3ec85d574f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1321 microversion: 2.1 time: 0.494800 Sep 11 00:56:34.565807 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 48/93] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:34 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:56:34.944490 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-b7c4c8c4-27ca-4387-8279-31a3dff0fa65 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:34.963750 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-b7c4c8c4-27ca-4387-8279-31a3dff0fa65 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1315 microversion: 2.1 time: 0.528040 Sep 11 00:56:34.983653 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 46/94] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:34 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:35.138000 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-41b3628d-97a5-4345-ada4-cbcfeb093456 req-b7aae241-c792-48dd-b9ab-a7402dda05da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "185afbdf-74f7-4a54-8ba8-58e7b6fd2e73", "tag": "903eede7-b91a-4899-9cea-f0ba8d7eea74"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:35.165424 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-41b3628d-97a5-4345-ada4-cbcfeb093456 req-b7aae241-c792-48dd-b9ab-a7402dda05da service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:35.166207 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-41b3628d-97a5-4345-ada4-cbcfeb093456 req-b7aae241-c792-48dd-b9ab-a7402dda05da service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:35.166804 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-41b3628d-97a5-4345-ada4-cbcfeb093456 req-b7aae241-c792-48dd-b9ab-a7402dda05da service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:35.188773 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-41b3628d-97a5-4345-ada4-cbcfeb093456 req-b7aae241-c792-48dd-b9ab-a7402dda05da service nova] Creating event network-changed:903eede7-b91a-4899-9cea-f0ba8d7eea74 for instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 on hv-cinder-maste Sep 11 00:56:35.197829 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-41b3628d-97a5-4345-ada4-cbcfeb093456 req-b7aae241-c792-48dd-b9ab-a7402dda05da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063245 Sep 11 00:56:35.198786 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 49/95] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:56:35.274256 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ee949bd7-23d7-4e09-afa6-c64f10e1c3c3 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:35.275269 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ee949bd7-23d7-4e09-afa6-c64f10e1c3c3 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:35.282046 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ee949bd7-23d7-4e09-afa6-c64f10e1c3c3 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:35.282892 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ee949bd7-23d7-4e09-afa6-c64f10e1c3c3 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:35.283559 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ee949bd7-23d7-4e09-afa6-c64f10e1c3c3 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:35.284632 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ee949bd7-23d7-4e09-afa6-c64f10e1c3c3 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:35.285296 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ee949bd7-23d7-4e09-afa6-c64f10e1c3c3 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:35.285903 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ee949bd7-23d7-4e09-afa6-c64f10e1c3c3 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:35.591732 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-87fea9b7-2ac6-4ddc-88b0-563dd9ecce6f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:35.592824 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-87fea9b7-2ac6-4ddc-88b0-563dd9ecce6f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:35.600048 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87fea9b7-2ac6-4ddc-88b0-563dd9ecce6f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:35.600687 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87fea9b7-2ac6-4ddc-88b0-563dd9ecce6f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:35.601289 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87fea9b7-2ac6-4ddc-88b0-563dd9ecce6f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:35.602123 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87fea9b7-2ac6-4ddc-88b0-563dd9ecce6f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:35.602834 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87fea9b7-2ac6-4ddc-88b0-563dd9ecce6f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:35.603964 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87fea9b7-2ac6-4ddc-88b0-563dd9ecce6f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:35.710906 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ee949bd7-23d7-4e09-afa6-c64f10e1c3c3 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:35.719919 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ee949bd7-23d7-4e09-afa6-c64f10e1c3c3 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 0.449686 Sep 11 00:56:35.721058 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 47/96] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:35 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:35.995009 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e991c164-e88a-48ff-ba71-8608b5314368 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:35.996400 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-e991c164-e88a-48ff-ba71-8608b5314368 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:36.012771 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e991c164-e88a-48ff-ba71-8608b5314368 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:36.013644 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e991c164-e88a-48ff-ba71-8608b5314368 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:36.014601 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e991c164-e88a-48ff-ba71-8608b5314368 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:36.015606 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e991c164-e88a-48ff-ba71-8608b5314368 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:36.016293 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e991c164-e88a-48ff-ba71-8608b5314368 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:36.016979 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e991c164-e88a-48ff-ba71-8608b5314368 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:36.155072 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-87fea9b7-2ac6-4ddc-88b0-563dd9ecce6f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:36.167493 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-87fea9b7-2ac6-4ddc-88b0-563dd9ecce6f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1321 microversion: 2.1 time: 0.580857 Sep 11 00:56:36.180927 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 50/97] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:35 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1321 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:36.304645 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-e991c164-e88a-48ff-ba71-8608b5314368 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:36.315368 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-e991c164-e88a-48ff-ba71-8608b5314368 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1315 microversion: 2.1 time: 0.330167 Sep 11 00:56:36.318071 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 48/98] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:35 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:36.338951 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-0e3c0ae2-6f02-4cd4-a5e5-2c651b05e90f req-a30c45fa-5fab-42e2-af85-afa5fcc04d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5a68ae4-8f64-474d-aca7-974bd8fd266a", "tag": "45e6e7a2-cde7-4a70-8d40-d6a3344f9545"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:36.359866 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0e3c0ae2-6f02-4cd4-a5e5-2c651b05e90f req-a30c45fa-5fab-42e2-af85-afa5fcc04d01 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:36.363082 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0e3c0ae2-6f02-4cd4-a5e5-2c651b05e90f req-a30c45fa-5fab-42e2-af85-afa5fcc04d01 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:36.363656 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0e3c0ae2-6f02-4cd4-a5e5-2c651b05e90f req-a30c45fa-5fab-42e2-af85-afa5fcc04d01 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:36.389490 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-0e3c0ae2-6f02-4cd4-a5e5-2c651b05e90f req-a30c45fa-5fab-42e2-af85-afa5fcc04d01 service nova] Creating event network-changed:45e6e7a2-cde7-4a70-8d40-d6a3344f9545 for instance a5a68ae4-8f64-474d-aca7-974bd8fd266a on hv-cinder-maste Sep 11 00:56:36.406378 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-0e3c0ae2-6f02-4cd4-a5e5-2c651b05e90f req-a30c45fa-5fab-42e2-af85-afa5fcc04d01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073206 Sep 11 00:56:36.407201 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 51/99] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:56:36.743568 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6cf84b45-d054-47d2-af2a-562c725835ac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:36.745169 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6cf84b45-d054-47d2-af2a-562c725835ac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:36.755431 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6cf84b45-d054-47d2-af2a-562c725835ac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:36.759125 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6cf84b45-d054-47d2-af2a-562c725835ac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:36.759848 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6cf84b45-d054-47d2-af2a-562c725835ac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:36.761220 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6cf84b45-d054-47d2-af2a-562c725835ac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:36.763793 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6cf84b45-d054-47d2-af2a-562c725835ac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:36.764469 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6cf84b45-d054-47d2-af2a-562c725835ac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:36.998534 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6cf84b45-d054-47d2-af2a-562c725835ac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:37.009386 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6cf84b45-d054-47d2-af2a-562c725835ac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 0.269373 Sep 11 00:56:37.010422 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 49/100] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:36 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:37.192275 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8e4b2f5c-ee69-49d4-94e9-53002d680a3b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:37.193726 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8e4b2f5c-ee69-49d4-94e9-53002d680a3b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:37.201254 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e4b2f5c-ee69-49d4-94e9-53002d680a3b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:37.202755 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e4b2f5c-ee69-49d4-94e9-53002d680a3b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:37.203278 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e4b2f5c-ee69-49d4-94e9-53002d680a3b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:37.204736 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e4b2f5c-ee69-49d4-94e9-53002d680a3b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:37.205976 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e4b2f5c-ee69-49d4-94e9-53002d680a3b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:37.206754 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e4b2f5c-ee69-49d4-94e9-53002d680a3b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:37.348801 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-522f6a6d-2897-4d96-9d62-a6150de58c44 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:37.349715 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-522f6a6d-2897-4d96-9d62-a6150de58c44 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:37.364660 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-522f6a6d-2897-4d96-9d62-a6150de58c44 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:37.365687 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-522f6a6d-2897-4d96-9d62-a6150de58c44 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:37.366122 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-522f6a6d-2897-4d96-9d62-a6150de58c44 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:37.366823 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-522f6a6d-2897-4d96-9d62-a6150de58c44 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:37.367292 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-522f6a6d-2897-4d96-9d62-a6150de58c44 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:37.376385 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-522f6a6d-2897-4d96-9d62-a6150de58c44 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:37.411959 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8e4b2f5c-ee69-49d4-94e9-53002d680a3b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:37.432678 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8e4b2f5c-ee69-49d4-94e9-53002d680a3b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1321 microversion: 2.1 time: 0.233060 Sep 11 00:56:37.432678 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 52/101] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:37 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:37.625728 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-522f6a6d-2897-4d96-9d62-a6150de58c44 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:37.645536 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-522f6a6d-2897-4d96-9d62-a6150de58c44 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1503 microversion: 2.1 time: 0.298742 Sep 11 00:56:37.648367 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 50/102] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:37 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:38.034330 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1c5becca-7039-4522-be52-3895d777df7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:38.035698 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1c5becca-7039-4522-be52-3895d777df7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:38.043399 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1c5becca-7039-4522-be52-3895d777df7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:38.045343 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1c5becca-7039-4522-be52-3895d777df7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:38.045979 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1c5becca-7039-4522-be52-3895d777df7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:38.046878 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1c5becca-7039-4522-be52-3895d777df7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:38.047446 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1c5becca-7039-4522-be52-3895d777df7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:38.048062 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1c5becca-7039-4522-be52-3895d777df7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:38.319777 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1c5becca-7039-4522-be52-3895d777df7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:38.334001 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1c5becca-7039-4522-be52-3895d777df7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1361 microversion: 2.1 time: 0.305712 Sep 11 00:56:38.334575 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 53/103] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:38 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1361 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:38.444306 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d878aa36-45a1-4642-821d-2f49a246305f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:38.444914 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d878aa36-45a1-4642-821d-2f49a246305f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:38.450988 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d878aa36-45a1-4642-821d-2f49a246305f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:38.451489 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d878aa36-45a1-4642-821d-2f49a246305f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:38.451915 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d878aa36-45a1-4642-821d-2f49a246305f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:38.452593 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d878aa36-45a1-4642-821d-2f49a246305f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:38.453038 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d878aa36-45a1-4642-821d-2f49a246305f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:38.453451 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d878aa36-45a1-4642-821d-2f49a246305f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:38.589684 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d878aa36-45a1-4642-821d-2f49a246305f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:38.597907 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d878aa36-45a1-4642-821d-2f49a246305f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1321 microversion: 2.1 time: 0.157502 Sep 11 00:56:38.598481 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 51/104] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:38 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:39.256921 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4f7870d1-8469-4b0b-a4c8-559ec23b00bb tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fd13e52-1564-40ee-a3df-9776f6250bce"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:39.259269 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4f7870d1-8469-4b0b-a4c8-559ec23b00bb tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:39.265819 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f7870d1-8469-4b0b-a4c8-559ec23b00bb tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:39.266473 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f7870d1-8469-4b0b-a4c8-559ec23b00bb tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:39.266927 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f7870d1-8469-4b0b-a4c8-559ec23b00bb tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:39.267825 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f7870d1-8469-4b0b-a4c8-559ec23b00bb tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:39.268277 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f7870d1-8469-4b0b-a4c8-559ec23b00bb tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:39.268698 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f7870d1-8469-4b0b-a4c8-559ec23b00bb tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:39.357886 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c066a21a-5019-4bb1-8e60-0d09c4872145 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:39.359300 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c066a21a-5019-4bb1-8e60-0d09c4872145 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:39.366642 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c066a21a-5019-4bb1-8e60-0d09c4872145 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:39.367229 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c066a21a-5019-4bb1-8e60-0d09c4872145 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:39.368102 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c066a21a-5019-4bb1-8e60-0d09c4872145 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:39.369134 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c066a21a-5019-4bb1-8e60-0d09c4872145 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:39.369797 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c066a21a-5019-4bb1-8e60-0d09c4872145 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:39.370664 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c066a21a-5019-4bb1-8e60-0d09c4872145 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:39.539283 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c066a21a-5019-4bb1-8e60-0d09c4872145 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:39.547833 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c066a21a-5019-4bb1-8e60-0d09c4872145 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1547 microversion: 2.1 time: 0.194765 Sep 11 00:56:39.548554 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 52/105] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:39 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1547 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:56:39.572527 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-7403e6e2-e899-473b-bf3e-68d388ca4625 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:39.573062 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-7403e6e2-e899-473b-bf3e-68d388ca4625 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:39.579045 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7403e6e2-e899-473b-bf3e-68d388ca4625 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:39.579671 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7403e6e2-e899-473b-bf3e-68d388ca4625 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:39.580096 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7403e6e2-e899-473b-bf3e-68d388ca4625 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:39.580796 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7403e6e2-e899-473b-bf3e-68d388ca4625 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:39.581235 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7403e6e2-e899-473b-bf3e-68d388ca4625 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:39.581642 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7403e6e2-e899-473b-bf3e-68d388ca4625 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:39.712152 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-7403e6e2-e899-473b-bf3e-68d388ca4625 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143121 Sep 11 00:56:39.713283 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 53/106] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Sep 11 00:56:39 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:56:39.719547 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-96a1cd5a-4ee1-4fd8-a660-069723f1683c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:39.720377 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-96a1cd5a-4ee1-4fd8-a660-069723f1683c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:39.727258 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-96a1cd5a-4ee1-4fd8-a660-069723f1683c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:39.727921 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-96a1cd5a-4ee1-4fd8-a660-069723f1683c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:39.728496 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-96a1cd5a-4ee1-4fd8-a660-069723f1683c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:39.729421 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-96a1cd5a-4ee1-4fd8-a660-069723f1683c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:39.729926 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-96a1cd5a-4ee1-4fd8-a660-069723f1683c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:39.730337 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-96a1cd5a-4ee1-4fd8-a660-069723f1683c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:40.017751 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-96a1cd5a-4ee1-4fd8-a660-069723f1683c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:40.025396 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-96a1cd5a-4ee1-4fd8-a660-069723f1683c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1515 microversion: 2.1 time: 0.310370 Sep 11 00:56:40.025972 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 54/107] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:39 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1515 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:40.049269 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-85cd038b-5dcb-4f41-80a4-63d8fa344e2a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:40.051638 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-85cd038b-5dcb-4f41-80a4-63d8fa344e2a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:40.057554 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-85cd038b-5dcb-4f41-80a4-63d8fa344e2a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:40.058028 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-85cd038b-5dcb-4f41-80a4-63d8fa344e2a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:40.058450 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-85cd038b-5dcb-4f41-80a4-63d8fa344e2a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:40.059132 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-85cd038b-5dcb-4f41-80a4-63d8fa344e2a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:40.059604 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-85cd038b-5dcb-4f41-80a4-63d8fa344e2a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:40.060016 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-85cd038b-5dcb-4f41-80a4-63d8fa344e2a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:40.083096 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-85cd038b-5dcb-4f41-80a4-63d8fa344e2a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lazy-loading 'flavor' on Instance uuid 67923a02-d1a5-4177-b7f3-15e4e795894a {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:56:40.203661 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-85cd038b-5dcb-4f41-80a4-63d8fa344e2a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "POST /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a/action" status: 200 len: 32 microversion: 2.1 time: 0.158775 Sep 11 00:56:40.204548 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 55/108] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Sep 11 00:56:40 2022] POST /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:56:40.215666 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-7a95036d-0eda-4e50-a5a9-f79a840fe211 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:40.216591 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-7a95036d-0eda-4e50-a5a9-f79a840fe211 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:40.223461 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7a95036d-0eda-4e50-a5a9-f79a840fe211 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:40.224625 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7a95036d-0eda-4e50-a5a9-f79a840fe211 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:40.225093 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7a95036d-0eda-4e50-a5a9-f79a840fe211 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:40.225806 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7a95036d-0eda-4e50-a5a9-f79a840fe211 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:40.226271 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7a95036d-0eda-4e50-a5a9-f79a840fe211 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:40.226704 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7a95036d-0eda-4e50-a5a9-f79a840fe211 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:40.778193 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-7a95036d-0eda-4e50-a5a9-f79a840fe211 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:40.787767 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-7a95036d-0eda-4e50-a5a9-f79a840fe211 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.576284 Sep 11 00:56:40.788620 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 56/109] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:40 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:56:41.156398 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-faa679a5-4e32-4b30-8c28-94b9c04ccc0a req-e6b69689-a17f-44ec-bd5d-7f97f5301aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11702158-2435-4d46-9e27-7ff56d83bca8", "tag": "6083c5ea-ec25-4a93-b7ff-4971543ff629"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:41.176529 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-faa679a5-4e32-4b30-8c28-94b9c04ccc0a req-e6b69689-a17f-44ec-bd5d-7f97f5301aec service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:41.177245 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-faa679a5-4e32-4b30-8c28-94b9c04ccc0a req-e6b69689-a17f-44ec-bd5d-7f97f5301aec service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:41.177863 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-faa679a5-4e32-4b30-8c28-94b9c04ccc0a req-e6b69689-a17f-44ec-bd5d-7f97f5301aec service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:41.189554 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-faa679a5-4e32-4b30-8c28-94b9c04ccc0a req-e6b69689-a17f-44ec-bd5d-7f97f5301aec service nova] Creating event network-changed:6083c5ea-ec25-4a93-b7ff-4971543ff629 for instance 11702158-2435-4d46-9e27-7ff56d83bca8 on hv-cinder-maste Sep 11 00:56:41.194301 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-faa679a5-4e32-4b30-8c28-94b9c04ccc0a req-e6b69689-a17f-44ec-bd5d-7f97f5301aec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045000 Sep 11 00:56:41.194903 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 57/110] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:56:41.722365 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4f7870d1-8469-4b0b-a4c8-559ec23b00bb tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.468876 Sep 11 00:56:41.723952 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 54/111] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Sep 11 00:56:39 2022] POST /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd/os-volume_attachments => generated 194 bytes in 2471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:56:41.814721 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-172a6026-6313-4eac-b9a2-3054bf065920 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:41.815450 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-172a6026-6313-4eac-b9a2-3054bf065920 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:41.822204 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-172a6026-6313-4eac-b9a2-3054bf065920 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:41.829173 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-172a6026-6313-4eac-b9a2-3054bf065920 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:41.829913 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-172a6026-6313-4eac-b9a2-3054bf065920 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:41.830652 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-172a6026-6313-4eac-b9a2-3054bf065920 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:41.831104 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-172a6026-6313-4eac-b9a2-3054bf065920 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:41.831576 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-172a6026-6313-4eac-b9a2-3054bf065920 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:42.152729 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-172a6026-6313-4eac-b9a2-3054bf065920 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:42.169954 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-172a6026-6313-4eac-b9a2-3054bf065920 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.360094 Sep 11 00:56:42.170658 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 58/112] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:41 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:43.195396 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9245b30e-4f42-4231-b11a-ff9d2b5eb3b5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:43.196703 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9245b30e-4f42-4231-b11a-ff9d2b5eb3b5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:43.204441 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9245b30e-4f42-4231-b11a-ff9d2b5eb3b5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:43.204934 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9245b30e-4f42-4231-b11a-ff9d2b5eb3b5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:43.205365 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9245b30e-4f42-4231-b11a-ff9d2b5eb3b5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:43.206233 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9245b30e-4f42-4231-b11a-ff9d2b5eb3b5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:43.206848 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9245b30e-4f42-4231-b11a-ff9d2b5eb3b5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:43.207577 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9245b30e-4f42-4231-b11a-ff9d2b5eb3b5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:43.349810 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-9245b30e-4f42-4231-b11a-ff9d2b5eb3b5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:43.358514 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9245b30e-4f42-4231-b11a-ff9d2b5eb3b5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.168203 Sep 11 00:56:43.359082 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 55/113] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:43 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:44.388663 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-fc310496-448c-499e-b941-2810c5b72db1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:44.389285 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-fc310496-448c-499e-b941-2810c5b72db1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:44.401282 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fc310496-448c-499e-b941-2810c5b72db1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:44.402184 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fc310496-448c-499e-b941-2810c5b72db1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:44.402768 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fc310496-448c-499e-b941-2810c5b72db1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:44.403640 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fc310496-448c-499e-b941-2810c5b72db1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:44.404231 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fc310496-448c-499e-b941-2810c5b72db1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:44.404818 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fc310496-448c-499e-b941-2810c5b72db1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:44.432058 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:44.565686 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-fc310496-448c-499e-b941-2810c5b72db1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:44.574508 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-fc310496-448c-499e-b941-2810c5b72db1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.195282 Sep 11 00:56:44.574983 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 59/114] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:44 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:45.135755 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c5c680be-8fd8-4654-8df1-1b1b9112be21 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:45.137013 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c5c680be-8fd8-4654-8df1-1b1b9112be21 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:45.148499 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5c680be-8fd8-4654-8df1-1b1b9112be21 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:45.149063 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5c680be-8fd8-4654-8df1-1b1b9112be21 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:45.149682 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5c680be-8fd8-4654-8df1-1b1b9112be21 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:45.150578 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5c680be-8fd8-4654-8df1-1b1b9112be21 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:45.151061 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5c680be-8fd8-4654-8df1-1b1b9112be21 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:45.151911 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5c680be-8fd8-4654-8df1-1b1b9112be21 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:45.182748 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c5c680be-8fd8-4654-8df1-1b1b9112be21 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:56:45.199915 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:45.292400 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c5c680be-8fd8-4654-8df1-1b1b9112be21 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 204 len: 0 microversion: 2.1 time: 0.161318 Sep 11 00:56:45.301690 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-da03a4d6-9f68-4408-85bb-207deb48b286 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:45.302292 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-da03a4d6-9f68-4408-85bb-207deb48b286 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:45.303221 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 56/115] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 00:56:45 2022] DELETE /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:56:45.308148 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-da03a4d6-9f68-4408-85bb-207deb48b286 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:45.308831 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-da03a4d6-9f68-4408-85bb-207deb48b286 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:45.309412 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-da03a4d6-9f68-4408-85bb-207deb48b286 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:45.310223 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-da03a4d6-9f68-4408-85bb-207deb48b286 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:45.310790 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-da03a4d6-9f68-4408-85bb-207deb48b286 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:45.311379 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-da03a4d6-9f68-4408-85bb-207deb48b286 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:45.472143 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-da03a4d6-9f68-4408-85bb-207deb48b286 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:45.481165 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-da03a4d6-9f68-4408-85bb-207deb48b286 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1555 microversion: 2.1 time: 0.183335 Sep 11 00:56:45.482054 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 60/116] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:45 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:56:45.597714 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e61f5f39-ecf5-4e1e-a94e-e5ced6d51bdb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:45.598406 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e61f5f39-ecf5-4e1e-a94e-e5ced6d51bdb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:45.604572 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e61f5f39-ecf5-4e1e-a94e-e5ced6d51bdb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:45.605262 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e61f5f39-ecf5-4e1e-a94e-e5ced6d51bdb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:45.605727 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e61f5f39-ecf5-4e1e-a94e-e5ced6d51bdb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:45.606403 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e61f5f39-ecf5-4e1e-a94e-e5ced6d51bdb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:45.606881 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e61f5f39-ecf5-4e1e-a94e-e5ced6d51bdb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:45.607325 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e61f5f39-ecf5-4e1e-a94e-e5ced6d51bdb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:45.746613 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e61f5f39-ecf5-4e1e-a94e-e5ced6d51bdb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:45.755043 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e61f5f39-ecf5-4e1e-a94e-e5ced6d51bdb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.161630 Sep 11 00:56:45.756019 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 57/117] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:45 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:46.505707 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0d9fa32c-18f6-463d-941e-6c60f08f0f6f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:46.506302 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-0d9fa32c-18f6-463d-941e-6c60f08f0f6f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:46.512864 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0d9fa32c-18f6-463d-941e-6c60f08f0f6f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:46.513341 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0d9fa32c-18f6-463d-941e-6c60f08f0f6f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:46.513773 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0d9fa32c-18f6-463d-941e-6c60f08f0f6f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:46.514474 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0d9fa32c-18f6-463d-941e-6c60f08f0f6f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:46.514924 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0d9fa32c-18f6-463d-941e-6c60f08f0f6f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:46.515402 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0d9fa32c-18f6-463d-941e-6c60f08f0f6f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:46.647532 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0d9fa32c-18f6-463d-941e-6c60f08f0f6f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:46.656635 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0d9fa32c-18f6-463d-941e-6c60f08f0f6f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1555 microversion: 2.1 time: 0.154878 Sep 11 00:56:46.657315 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 61/118] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:46 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:56:46.779556 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-33404ab0-9df5-4519-8ba7-ba93a32404d5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:46.780168 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-33404ab0-9df5-4519-8ba7-ba93a32404d5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:46.788096 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33404ab0-9df5-4519-8ba7-ba93a32404d5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:46.788608 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33404ab0-9df5-4519-8ba7-ba93a32404d5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:46.789026 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33404ab0-9df5-4519-8ba7-ba93a32404d5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:46.789728 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33404ab0-9df5-4519-8ba7-ba93a32404d5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:46.790186 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33404ab0-9df5-4519-8ba7-ba93a32404d5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:46.790741 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33404ab0-9df5-4519-8ba7-ba93a32404d5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:46.943446 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-33404ab0-9df5-4519-8ba7-ba93a32404d5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:46.955005 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-33404ab0-9df5-4519-8ba7-ba93a32404d5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.179700 Sep 11 00:56:46.955901 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 58/119] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:46 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:47.680897 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ac4ea93b-8b6f-4958-83f2-7c150c249652 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:47.681457 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ac4ea93b-8b6f-4958-83f2-7c150c249652 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:47.688215 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac4ea93b-8b6f-4958-83f2-7c150c249652 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:47.688872 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac4ea93b-8b6f-4958-83f2-7c150c249652 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:47.689324 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac4ea93b-8b6f-4958-83f2-7c150c249652 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:47.689987 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac4ea93b-8b6f-4958-83f2-7c150c249652 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:47.690530 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac4ea93b-8b6f-4958-83f2-7c150c249652 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:47.690934 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac4ea93b-8b6f-4958-83f2-7c150c249652 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:47.826254 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ac4ea93b-8b6f-4958-83f2-7c150c249652 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:47.835492 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ac4ea93b-8b6f-4958-83f2-7c150c249652 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1555 microversion: 2.1 time: 0.158481 Sep 11 00:56:47.836073 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 62/120] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:47 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:47.982053 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-008a08cf-4581-47e9-af52-e673c355c20c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:47.982643 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-008a08cf-4581-47e9-af52-e673c355c20c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:47.989756 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-008a08cf-4581-47e9-af52-e673c355c20c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:47.990234 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-008a08cf-4581-47e9-af52-e673c355c20c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:47.990663 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-008a08cf-4581-47e9-af52-e673c355c20c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:47.991420 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-008a08cf-4581-47e9-af52-e673c355c20c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:47.991863 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-008a08cf-4581-47e9-af52-e673c355c20c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:47.992301 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-008a08cf-4581-47e9-af52-e673c355c20c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:48.254781 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-008a08cf-4581-47e9-af52-e673c355c20c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:48.264416 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-008a08cf-4581-47e9-af52-e673c355c20c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.286234 Sep 11 00:56:48.265091 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 59/121] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:47 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:48.594593 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-100eac4f-1317-4393-b2d5-3c8d0a124b53 req-b1051074-56a6-4bd4-8654-a0a2db16ea5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee33cc4-87a0-41a6-8838-5feba8a3a9bd", "name": "network-vif-deleted", "tag": "d0e5f32c-3edd-4dad-89f8-2185777781b5"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:56:48.605808 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-100eac4f-1317-4393-b2d5-3c8d0a124b53 req-b1051074-56a6-4bd4-8654-a0a2db16ea5a service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:48.606289 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-100eac4f-1317-4393-b2d5-3c8d0a124b53 req-b1051074-56a6-4bd4-8654-a0a2db16ea5a service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:48.606715 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-100eac4f-1317-4393-b2d5-3c8d0a124b53 req-b1051074-56a6-4bd4-8654-a0a2db16ea5a service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:48.618730 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-100eac4f-1317-4393-b2d5-3c8d0a124b53 req-b1051074-56a6-4bd4-8654-a0a2db16ea5a service nova] Creating event network-vif-deleted:d0e5f32c-3edd-4dad-89f8-2185777781b5 for instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd on hv-cinder-maste Sep 11 00:56:48.623930 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-100eac4f-1317-4393-b2d5-3c8d0a124b53 req-b1051074-56a6-4bd4-8654-a0a2db16ea5a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033031 Sep 11 00:56:48.624531 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 63/122] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:56:48.862007 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-43fe1327-297f-43e5-984e-4fe08988f9b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:48.862650 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-43fe1327-297f-43e5-984e-4fe08988f9b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:48.864631 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:48.869837 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43fe1327-297f-43e5-984e-4fe08988f9b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:48.870316 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43fe1327-297f-43e5-984e-4fe08988f9b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:48.870744 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43fe1327-297f-43e5-984e-4fe08988f9b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:48.871457 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43fe1327-297f-43e5-984e-4fe08988f9b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:48.871904 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43fe1327-297f-43e5-984e-4fe08988f9b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:48.872322 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43fe1327-297f-43e5-984e-4fe08988f9b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:48.938262 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-43fe1327-297f-43e5-984e-4fe08988f9b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f06b14789a2740eca22001c0b5232fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58c81f2e94dd79d2fdcf08b260636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:48.947050 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-43fe1327-297f-43e5-984e-4fe08988f9b5 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 200 len: 1346 microversion: 2.1 time: 0.088944 Sep 11 00:56:48.947668 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 60/123] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:48 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:49.287697 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6242eb4c-b329-4d3f-a98b-fccdbf6ac176 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:49.288558 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6242eb4c-b329-4d3f-a98b-fccdbf6ac176 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:49.296368 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6242eb4c-b329-4d3f-a98b-fccdbf6ac176 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:49.296913 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6242eb4c-b329-4d3f-a98b-fccdbf6ac176 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:49.297403 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6242eb4c-b329-4d3f-a98b-fccdbf6ac176 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:49.298149 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6242eb4c-b329-4d3f-a98b-fccdbf6ac176 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:49.298658 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6242eb4c-b329-4d3f-a98b-fccdbf6ac176 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:49.299149 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6242eb4c-b329-4d3f-a98b-fccdbf6ac176 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:49.432676 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6242eb4c-b329-4d3f-a98b-fccdbf6ac176 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:49.441355 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6242eb4c-b329-4d3f-a98b-fccdbf6ac176 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.157802 Sep 11 00:56:49.442014 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 64/124] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:49 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:49.970175 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a02c3e89-1edb-4bee-b1bc-58be519f5d32 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:49.971109 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a02c3e89-1edb-4bee-b1bc-58be519f5d32 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:49.978627 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a02c3e89-1edb-4bee-b1bc-58be519f5d32 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:49.979205 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a02c3e89-1edb-4bee-b1bc-58be519f5d32 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:49.979680 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a02c3e89-1edb-4bee-b1bc-58be519f5d32 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:49.980446 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a02c3e89-1edb-4bee-b1bc-58be519f5d32 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:49.980898 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a02c3e89-1edb-4bee-b1bc-58be519f5d32 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:49.981343 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a02c3e89-1edb-4bee-b1bc-58be519f5d32 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:49.999118 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-a02c3e89-1edb-4bee-b1bc-58be519f5d32 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] HTTP exception thrown: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a02c3e89-1edb-4bee-b1bc-58be519f5d32 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Request method failure captured: Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd HTTP/1.1 Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIcRnjiC3mHpMWJKUNNiYI6AiX3GFTl7apNQ6WHoB_FvxxWlrSmCKwk-Y5491xCmaX6vqpnBc4aXtEy_4XGmIIyJeqVEnh1q9bXvZqcf92ip5pBZCAH5b5w7E8jLmYQbTqrLza7zx1Dv44pacQ_aA3if-NTeyPojoXFYDsdp_prlUE Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: a2d58c81f2e94dd79d2fdcf08b260636 Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-DeleteServersTestJSON-2000807612 Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 00:56:50.004405 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 00:56:50.005878 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a2d58c81f2e94dd79d2fdcf08b260636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a2d58c81f2e94dd79d2fdcf08b260636"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a2d58c81f2e94dd79d2fdcf08b260636"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a2d58c81f2e94dd79d2fdcf08b260636", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:56:50.005878 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-DeleteServersTestJSON-2000807612 Sep 11 00:56:50.005878 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: a2d58c81f2e94dd79d2fdcf08b260636 Sep 11 00:56:50.005878 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-DeleteServersTestJSON-2000807612 Sep 11 00:56:50.005878 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-DeleteServersTestJSON-2000807612-project Sep 11 00:56:50.005878 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 00:56:50.005878 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 00:56:50.005878 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: f06b14789a2740eca22001c0b5232fc4 Sep 11 00:56:50.005878 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-DeleteServersTestJSON-2000807612-project Sep 11 00:56:50.005878 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 00:56:50.005878 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:50.005878 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': '2ee33cc4-87a0-41a6-8838-5feba8a3a9bd'} Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:56:50.006733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:50.007973 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:56:50.009266 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a02c3e89-1edb-4bee-b1bc-58be519f5d32 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Returning 404 to user: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:56:50.009266 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a02c3e89-1edb-4bee-b1bc-58be519f5d32 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 404 len: 111 microversion: 2.1 time: 0.040878 Sep 11 00:56:50.009266 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 61/125] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:49 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:56:50.124189 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6a63e267-69b8-41c1-b881-c96a36a9744f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:50.126319 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6a63e267-69b8-41c1-b881-c96a36a9744f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:50.132797 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6a63e267-69b8-41c1-b881-c96a36a9744f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:50.133288 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6a63e267-69b8-41c1-b881-c96a36a9744f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:50.133713 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6a63e267-69b8-41c1-b881-c96a36a9744f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:50.134399 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6a63e267-69b8-41c1-b881-c96a36a9744f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:50.134844 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6a63e267-69b8-41c1-b881-c96a36a9744f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:50.135287 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6a63e267-69b8-41c1-b881-c96a36a9744f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:50.148626 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-6a63e267-69b8-41c1-b881-c96a36a9744f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] HTTP exception thrown: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6a63e267-69b8-41c1-b881-c96a36a9744f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Request method failure captured: Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd/os-volume_attachments HTTP/1.1 Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTIcRnjiC3mHpMWJKUNNiYI6AiX3GFTl7apNQ6WHoB_FvxxWlrSmCKwk-Y5491xCmaX6vqpnBc4aXtEy_4XGmIIyJeqVEnh1q9bXvZqcf92ip5pBZCAH5b5w7E8jLmYQbTqrLza7zx1Dv44pacQ_aA3if-NTeyPojoXFYDsdp_prlUE Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: a2d58c81f2e94dd79d2fdcf08b260636 Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-DeleteServersTestJSON-2000807612 Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 00:56:50.153191 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 00:56:50.154500 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a2d58c81f2e94dd79d2fdcf08b260636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a2d58c81f2e94dd79d2fdcf08b260636"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a2d58c81f2e94dd79d2fdcf08b260636"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a2d58c81f2e94dd79d2fdcf08b260636", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:56:50.154500 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-DeleteServersTestJSON-2000807612 Sep 11 00:56:50.154500 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: a2d58c81f2e94dd79d2fdcf08b260636 Sep 11 00:56:50.154500 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-DeleteServersTestJSON-2000807612 Sep 11 00:56:50.154500 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-DeleteServersTestJSON-2000807612-project Sep 11 00:56:50.154500 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 00:56:50.154500 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 00:56:50.154500 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: f06b14789a2740eca22001c0b5232fc4 Sep 11 00:56:50.154500 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-DeleteServersTestJSON-2000807612-project Sep 11 00:56:50.154500 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 00:56:50.154500 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:50.154500 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'server_id': '2ee33cc4-87a0-41a6-8838-5feba8a3a9bd'} Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:56:50.155268 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:50.156564 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:56:50.157813 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6a63e267-69b8-41c1-b881-c96a36a9744f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Returning 404 to user: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:56:50.157813 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6a63e267-69b8-41c1-b881-c96a36a9744f tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034436 Sep 11 00:56:50.157813 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 65/126] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 00:56:50 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:56:50.466886 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bed65d9c-39a8-4c53-8896-9ea073b61c7e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:50.467464 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bed65d9c-39a8-4c53-8896-9ea073b61c7e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:50.474092 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bed65d9c-39a8-4c53-8896-9ea073b61c7e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:50.474582 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bed65d9c-39a8-4c53-8896-9ea073b61c7e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:50.475016 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bed65d9c-39a8-4c53-8896-9ea073b61c7e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:50.475755 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bed65d9c-39a8-4c53-8896-9ea073b61c7e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:50.476206 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bed65d9c-39a8-4c53-8896-9ea073b61c7e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:50.476862 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bed65d9c-39a8-4c53-8896-9ea073b61c7e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:50.611428 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-bed65d9c-39a8-4c53-8896-9ea073b61c7e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:50.619728 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bed65d9c-39a8-4c53-8896-9ea073b61c7e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.156934 Sep 11 00:56:50.620306 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 62/127] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:50 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:51.382502 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6db5849c-f95c-4153-adbb-c589a488c571 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:51.383388 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6db5849c-f95c-4153-adbb-c589a488c571 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:51.390177 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6db5849c-f95c-4153-adbb-c589a488c571 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:51.390655 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6db5849c-f95c-4153-adbb-c589a488c571 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:51.391085 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6db5849c-f95c-4153-adbb-c589a488c571 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:51.391808 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6db5849c-f95c-4153-adbb-c589a488c571 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:51.392297 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6db5849c-f95c-4153-adbb-c589a488c571 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:51.392704 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6db5849c-f95c-4153-adbb-c589a488c571 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:51.407303 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-6db5849c-f95c-4153-adbb-c589a488c571 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] HTTP exception thrown: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6db5849c-f95c-4153-adbb-c589a488c571 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Request method failure captured: Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: DELETE /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd HTTP/1.1 Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTIcRnjiC3mHpMWJKUNNiYI6AiX3GFTl7apNQ6WHoB_FvxxWlrSmCKwk-Y5491xCmaX6vqpnBc4aXtEy_4XGmIIyJeqVEnh1q9bXvZqcf92ip5pBZCAH5b5w7E8jLmYQbTqrLza7zx1Dv44pacQ_aA3if-NTeyPojoXFYDsdp_prlUE Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: a2d58c81f2e94dd79d2fdcf08b260636 Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-DeleteServersTestJSON-2000807612 Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 00:56:51.409476 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 00:56:51.410922 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a2d58c81f2e94dd79d2fdcf08b260636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a2d58c81f2e94dd79d2fdcf08b260636"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a2d58c81f2e94dd79d2fdcf08b260636"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a2d58c81f2e94dd79d2fdcf08b260636", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:56:51.410922 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-DeleteServersTestJSON-2000807612 Sep 11 00:56:51.410922 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: a2d58c81f2e94dd79d2fdcf08b260636 Sep 11 00:56:51.410922 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-DeleteServersTestJSON-2000807612 Sep 11 00:56:51.410922 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-DeleteServersTestJSON-2000807612-project Sep 11 00:56:51.410922 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 00:56:51.410922 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 00:56:51.410922 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: f06b14789a2740eca22001c0b5232fc4 Sep 11 00:56:51.410922 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-DeleteServersTestJSON-2000807612-project Sep 11 00:56:51.410922 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 00:56:51.410922 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:51.410922 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': '2ee33cc4-87a0-41a6-8838-5feba8a3a9bd'} Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:56:51.411755 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:51.413012 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:56:51.414296 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6db5849c-f95c-4153-adbb-c589a488c571 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Returning 404 to user: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:56:51.414296 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6db5849c-f95c-4153-adbb-c589a488c571 tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 404 len: 111 microversion: 2.1 time: 0.033285 Sep 11 00:56:51.414296 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 66/128] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 00:56:51 2022] DELETE /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:56:51.420200 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ee9911fa-6dc2-435c-8684-c75721c7256d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:51.420754 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ee9911fa-6dc2-435c-8684-c75721c7256d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] [instance: 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:51.427342 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ee9911fa-6dc2-435c-8684-c75721c7256d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:51.428031 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ee9911fa-6dc2-435c-8684-c75721c7256d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:51.428463 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ee9911fa-6dc2-435c-8684-c75721c7256d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:51.429165 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ee9911fa-6dc2-435c-8684-c75721c7256d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:51.429617 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ee9911fa-6dc2-435c-8684-c75721c7256d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:51.430048 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ee9911fa-6dc2-435c-8684-c75721c7256d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:51.445761 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-ee9911fa-6dc2-435c-8684-c75721c7256d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] HTTP exception thrown: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ee9911fa-6dc2-435c-8684-c75721c7256d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Request method failure captured: Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd HTTP/1.1 Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIcRnjiC3mHpMWJKUNNiYI6AiX3GFTl7apNQ6WHoB_FvxxWlrSmCKwk-Y5491xCmaX6vqpnBc4aXtEy_4XGmIIyJeqVEnh1q9bXvZqcf92ip5pBZCAH5b5w7E8jLmYQbTqrLza7zx1Dv44pacQ_aA3if-NTeyPojoXFYDsdp_prlUE Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: a2d58c81f2e94dd79d2fdcf08b260636 Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-DeleteServersTestJSON-2000807612 Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 00:56:51.447326 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 00:56:51.448892 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a2d58c81f2e94dd79d2fdcf08b260636"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a2d58c81f2e94dd79d2fdcf08b260636"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a2d58c81f2e94dd79d2fdcf08b260636"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a2d58c81f2e94dd79d2fdcf08b260636", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:56:51.448892 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-DeleteServersTestJSON-2000807612 Sep 11 00:56:51.448892 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: a2d58c81f2e94dd79d2fdcf08b260636 Sep 11 00:56:51.448892 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-DeleteServersTestJSON-2000807612 Sep 11 00:56:51.448892 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-DeleteServersTestJSON-2000807612-project Sep 11 00:56:51.448892 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 00:56:51.448892 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 00:56:51.448892 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: f06b14789a2740eca22001c0b5232fc4 Sep 11 00:56:51.448892 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-DeleteServersTestJSON-2000807612-project Sep 11 00:56:51.448892 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 00:56:51.448892 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:51.448892 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': '2ee33cc4-87a0-41a6-8838-5feba8a3a9bd'} Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:56:51.450032 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. Sep 11 00:56:51.451519 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:56:51.454017 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ee9911fa-6dc2-435c-8684-c75721c7256d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] Returning 404 to user: Instance 2ee33cc4-87a0-41a6-8838-5feba8a3a9bd could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:56:51.454017 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ee9911fa-6dc2-435c-8684-c75721c7256d tempest-DeleteServersTestJSON-2000807612 tempest-DeleteServersTestJSON-2000807612-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd" status: 404 len: 111 microversion: 2.1 time: 0.032880 Sep 11 00:56:51.454017 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 63/129] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:51 2022] GET /compute/v2.1/servers/2ee33cc4-87a0-41a6-8838-5feba8a3a9bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:56:51.644038 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e8405e91-ff81-4457-b550-25949155005f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:51.645324 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-e8405e91-ff81-4457-b550-25949155005f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:51.654128 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=91 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:51.657767 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e8405e91-ff81-4457-b550-25949155005f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:51.658684 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e8405e91-ff81-4457-b550-25949155005f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:51.659409 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e8405e91-ff81-4457-b550-25949155005f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:51.660662 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e8405e91-ff81-4457-b550-25949155005f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:51.661390 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e8405e91-ff81-4457-b550-25949155005f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:51.662353 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e8405e91-ff81-4457-b550-25949155005f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:51.890299 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-e8405e91-ff81-4457-b550-25949155005f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:51.899551 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-e8405e91-ff81-4457-b550-25949155005f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.261482 Sep 11 00:56:51.909400 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 67/130] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:51 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:52.923634 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c5d1c2fa-4b38-4d7a-9738-0c319e7c917c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:52.924241 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c5d1c2fa-4b38-4d7a-9738-0c319e7c917c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:52.930827 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5d1c2fa-4b38-4d7a-9738-0c319e7c917c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:52.931354 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5d1c2fa-4b38-4d7a-9738-0c319e7c917c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:52.931782 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5d1c2fa-4b38-4d7a-9738-0c319e7c917c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:52.932478 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5d1c2fa-4b38-4d7a-9738-0c319e7c917c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:52.932913 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5d1c2fa-4b38-4d7a-9738-0c319e7c917c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:52.933327 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5d1c2fa-4b38-4d7a-9738-0c319e7c917c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:53.142381 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c5d1c2fa-4b38-4d7a-9738-0c319e7c917c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:53.164898 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c5d1c2fa-4b38-4d7a-9738-0c319e7c917c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.245671 Sep 11 00:56:53.166087 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 64/131] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:52 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:54.189342 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8fa0e727-7e17-4ed0-8f88-9574255bd068 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:54.189939 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-8fa0e727-7e17-4ed0-8f88-9574255bd068 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:54.197027 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8fa0e727-7e17-4ed0-8f88-9574255bd068 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:54.198409 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8fa0e727-7e17-4ed0-8f88-9574255bd068 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:54.202550 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8fa0e727-7e17-4ed0-8f88-9574255bd068 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:54.204001 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8fa0e727-7e17-4ed0-8f88-9574255bd068 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:54.205109 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8fa0e727-7e17-4ed0-8f88-9574255bd068 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:54.205831 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8fa0e727-7e17-4ed0-8f88-9574255bd068 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:54.478076 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8fa0e727-7e17-4ed0-8f88-9574255bd068 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:54.495952 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8fa0e727-7e17-4ed0-8f88-9574255bd068 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.310051 Sep 11 00:56:54.510231 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 68/132] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:54 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:55.525140 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6663bf5a-6adf-462b-9c29-f5e7767a0466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:55.526023 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6663bf5a-6adf-462b-9c29-f5e7767a0466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:55.537755 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6663bf5a-6adf-462b-9c29-f5e7767a0466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:55.538811 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6663bf5a-6adf-462b-9c29-f5e7767a0466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:55.539472 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6663bf5a-6adf-462b-9c29-f5e7767a0466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:55.540400 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6663bf5a-6adf-462b-9c29-f5e7767a0466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:55.541030 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6663bf5a-6adf-462b-9c29-f5e7767a0466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:55.541937 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6663bf5a-6adf-462b-9c29-f5e7767a0466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:55.789277 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6663bf5a-6adf-462b-9c29-f5e7767a0466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:55.799964 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6663bf5a-6adf-462b-9c29-f5e7767a0466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.283870 Sep 11 00:56:55.815205 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 65/133] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:55 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:56.824971 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-7e3b67f8-2511-4fe7-9981-3d1492199cef tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:56.826505 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-7e3b67f8-2511-4fe7-9981-3d1492199cef tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:56.833947 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7e3b67f8-2511-4fe7-9981-3d1492199cef tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:56.835000 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7e3b67f8-2511-4fe7-9981-3d1492199cef tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:56.835680 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7e3b67f8-2511-4fe7-9981-3d1492199cef tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:56.836625 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7e3b67f8-2511-4fe7-9981-3d1492199cef tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:56.837288 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7e3b67f8-2511-4fe7-9981-3d1492199cef tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:56.838178 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7e3b67f8-2511-4fe7-9981-3d1492199cef tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:56.997654 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-7e3b67f8-2511-4fe7-9981-3d1492199cef tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:57.007648 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-7e3b67f8-2511-4fe7-9981-3d1492199cef tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.186448 Sep 11 00:56:57.008837 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 69/134] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:56 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:58.031600 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f7954b82-034f-4bfc-870e-d423d7067e3f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:58.032196 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f7954b82-034f-4bfc-870e-d423d7067e3f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:58.039027 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f7954b82-034f-4bfc-870e-d423d7067e3f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:58.039571 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f7954b82-034f-4bfc-870e-d423d7067e3f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:58.040137 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f7954b82-034f-4bfc-870e-d423d7067e3f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:58.040706 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f7954b82-034f-4bfc-870e-d423d7067e3f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:58.041158 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f7954b82-034f-4bfc-870e-d423d7067e3f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:58.041565 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f7954b82-034f-4bfc-870e-d423d7067e3f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:58.247473 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f7954b82-034f-4bfc-870e-d423d7067e3f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:58.255364 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f7954b82-034f-4bfc-870e-d423d7067e3f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.227815 Sep 11 00:56:58.255928 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 66/135] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:58 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:56:58.923595 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-7e45e694-039f-42d6-b3f8-f9d0de163f21 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] Calling method '.version_select at 0x7fbb9158e4c0>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:59.035761 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-7e45e694-039f-42d6-b3f8-f9d0de163f21 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/853c4984-1e70-4cf5-8649-4e6de34f4667" status: 200 len: 350 microversion: 2.1 time: 0.120333 Sep 11 00:56:59.045618 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 70/136] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Sep 11 00:56:58 2022] GET /compute/v2.1/os-volumes/853c4984-1e70-4cf5-8649-4e6de34f4667 => generated 350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:56:59.278846 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4cd19bfb-cddd-43ab-83cf-9d41cc11b2fb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:56:59.279491 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4cd19bfb-cddd-43ab-83cf-9d41cc11b2fb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:56:59.286838 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4cd19bfb-cddd-43ab-83cf-9d41cc11b2fb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:59.287362 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4cd19bfb-cddd-43ab-83cf-9d41cc11b2fb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:59.287800 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4cd19bfb-cddd-43ab-83cf-9d41cc11b2fb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:59.288498 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4cd19bfb-cddd-43ab-83cf-9d41cc11b2fb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:56:59.288948 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4cd19bfb-cddd-43ab-83cf-9d41cc11b2fb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:56:59.289368 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4cd19bfb-cddd-43ab-83cf-9d41cc11b2fb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:56:59.420941 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4cd19bfb-cddd-43ab-83cf-9d41cc11b2fb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:56:59.428971 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4cd19bfb-cddd-43ab-83cf-9d41cc11b2fb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.154558 Sep 11 00:56:59.429559 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 67/137] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:56:59 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:00.227098 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1387012739", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "networks": [{"uuid": "6ccc5063-a369-45c1-8051-9a94c49384ca"}]}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:00.282240 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.network.neutron [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] validate_networks() for [('6ccc5063-a369-45c1-8051-9a94c49384ca', None, None, None, None, None)] {{(pid=120497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:57:00.412911 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-212cf683-19d9-42fb-bb58-0d22a7a75661 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] Calling method '.version_select at 0x7fbb909a54c0>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:00.466204 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-212cf683-19d9-42fb-bb58-0d22a7a75661 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/868f4e93-47ec-4fb4-ac01-5b811987991c" status: 200 len: 351 microversion: 2.1 time: 0.056623 Sep 11 00:57:00.467464 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 68/138] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Sep 11 00:57:00 2022] GET /compute/v2.1/os-volumes/868f4e93-47ec-4fb4-ac01-5b811987991c => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:57:00.479957 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3e4b85a6-bf3f-45da-a12b-910d0f8ab2ad tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:00.480506 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3e4b85a6-bf3f-45da-a12b-910d0f8ab2ad tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:00.486526 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e4b85a6-bf3f-45da-a12b-910d0f8ab2ad tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:00.487223 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e4b85a6-bf3f-45da-a12b-910d0f8ab2ad tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:00.487668 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e4b85a6-bf3f-45da-a12b-910d0f8ab2ad tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:00.488417 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e4b85a6-bf3f-45da-a12b-910d0f8ab2ad tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:00.488863 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e4b85a6-bf3f-45da-a12b-910d0f8ab2ad tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:00.489281 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e4b85a6-bf3f-45da-a12b-910d0f8ab2ad tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:00.705929 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3e4b85a6-bf3f-45da-a12b-910d0f8ab2ad tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:00.713379 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3e4b85a6-bf3f-45da-a12b-910d0f8ab2ad tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.237289 Sep 11 00:57:00.714158 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 69/139] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:00 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:00.743381 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Flavor limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:57:00.743811 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Image limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:57:00.744672 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Flavor pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:57:00.745266 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Image pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:57:00.745835 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:57:00.755127 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:00.755633 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:00.756052 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:00.756989 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:00.757350 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:00.757947 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:00.774809 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Getting quotas for project a84206f4832a4edda41c06ab2178c9a5. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:57:00.778839 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Getting quotas for user 398da9e11a194b9f9644dfad517d07b4 and project a84206f4832a4edda41c06ab2178c9a5. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:57:00.789771 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Going to run 1 instances... {{(pid=120497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:57:00.792273 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:57:00.841160 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-dd2ec39b-562a-40cf-9961-81c84116702a tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618677 Sep 11 00:57:00.841790 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 71/140] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 00:57:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:57:00.853332 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9930ebb6-24c8-414f-b8c6-0ca1b9982b5f tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:00.854206 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9930ebb6-24c8-414f-b8c6-0ca1b9982b5f tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:00.910445 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-9930ebb6-24c8-414f-b8c6-0ca1b9982b5f tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:00.919906 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9930ebb6-24c8-414f-b8c6-0ca1b9982b5f tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 200 len: 1214 microversion: 2.1 time: 0.070412 Sep 11 00:57:00.920743 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 70/141] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:00 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:01.737186 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-1723aadd-7f7b-4e3b-ac63-8f588df79184 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:01.737771 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-1723aadd-7f7b-4e3b-ac63-8f588df79184 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:01.744709 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1723aadd-7f7b-4e3b-ac63-8f588df79184 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:01.745195 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1723aadd-7f7b-4e3b-ac63-8f588df79184 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:01.745624 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1723aadd-7f7b-4e3b-ac63-8f588df79184 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:01.746302 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1723aadd-7f7b-4e3b-ac63-8f588df79184 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:01.746753 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1723aadd-7f7b-4e3b-ac63-8f588df79184 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:01.747168 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1723aadd-7f7b-4e3b-ac63-8f588df79184 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:01.835969 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-27affaff-8315-4ae3-9e1b-5e5ebb722e0b tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] Calling method '.version_select at 0x7fbb90a301f0>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:01.888160 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-27affaff-8315-4ae3-9e1b-5e5ebb722e0b tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/6a7e3c06-e692-4224-8795-5059c40e2069" status: 200 len: 351 microversion: 2.1 time: 0.055586 Sep 11 00:57:01.896026 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 71/142] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Sep 11 00:57:01 2022] GET /compute/v2.1/os-volumes/6a7e3c06-e692-4224-8795-5059c40e2069 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:57:01.897159 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1723aadd-7f7b-4e3b-ac63-8f588df79184 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:01.906271 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e5c98854-11c0-40eb-90e8-b72bb8ed69e1 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] Calling method '.version_select at 0x7fbb90a169d0>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:01.906490 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-1723aadd-7f7b-4e3b-ac63-8f588df79184 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.173206 Sep 11 00:57:01.907094 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 72/143] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:01 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:01.943281 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c445a2ea-e8f8-416b-a9f8-078a7d95c22e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:01.944240 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c445a2ea-e8f8-416b-a9f8-078a7d95c22e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:01.950417 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c445a2ea-e8f8-416b-a9f8-078a7d95c22e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:01.950976 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c445a2ea-e8f8-416b-a9f8-078a7d95c22e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:01.951517 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c445a2ea-e8f8-416b-a9f8-078a7d95c22e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:01.952273 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c445a2ea-e8f8-416b-a9f8-078a7d95c22e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:01.952802 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c445a2ea-e8f8-416b-a9f8-078a7d95c22e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:01.953282 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c445a2ea-e8f8-416b-a9f8-078a7d95c22e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:02.001345 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e5c98854-11c0-40eb-90e8-b72bb8ed69e1 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.102235 Sep 11 00:57:02.001922 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 72/144] 10.222.0.23 () {58 vars in 1134 bytes} [Sun Sep 11 00:57:01 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:02.015452 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c445a2ea-e8f8-416b-a9f8-078a7d95c22e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:02.016128 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-31352b3f-6130-48d9-a7a1-532edd5b445d tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] Calling method '.version_select at 0x7fbb909a5280>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:02.024012 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c445a2ea-e8f8-416b-a9f8-078a7d95c22e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 200 len: 1266 microversion: 2.1 time: 0.084841 Sep 11 00:57:02.024640 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 73/145] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:01 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:02.100610 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-31352b3f-6130-48d9-a7a1-532edd5b445d tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088274 Sep 11 00:57:02.101186 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 73/146] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Sep 11 00:57:02 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:57:02.117565 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-23327eb6-581f-4fa7-b102-a2deebfd4363 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] Calling method '.version_select at 0x7fbb9094bf70>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:02.203415 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-23327eb6-581f-4fa7-b102-a2deebfd4363 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090224 Sep 11 00:57:02.203415 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 74/147] 10.222.0.23 () {58 vars in 1134 bytes} [Sun Sep 11 00:57:02 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:02.220486 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6c8f4fab-8bd7-421a-9fea-6712b2403485 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] Calling method '.version_select at 0x7fbb90a16a60>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:02.310245 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6c8f4fab-8bd7-421a-9fea-6712b2403485 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093552 Sep 11 00:57:02.310835 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 74/148] 10.222.0.23 () {58 vars in 1167 bytes} [Sun Sep 11 00:57:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:57:02.324690 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b62faef0-1124-4940-805a-7e3adcf7d170 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] Calling method '.version_select at 0x7fbb90b56670>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:02.407015 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-b62faef0-1124-4940-805a-7e3adcf7d170 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086084 Sep 11 00:57:02.407796 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 75/149] 10.222.0.23 () {58 vars in 1170 bytes} [Sun Sep 11 00:57:02 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:57:02.421998 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aed8255a-e52a-4218-8bd2-8e6c6d7a3f3b tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] Calling method '.version_select at 0x7fbb90a16dc0>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:02.509179 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-aed8255a-e52a-4218-8bd2-8e6c6d7a3f3b tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091367 Sep 11 00:57:02.509992 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 75/150] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Sep 11 00:57:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:02.523686 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-88503815-ad12-404e-94ed-0b9422bc1042 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] Calling method '.version_select at 0x7fbb90b56ca0>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:02.680533 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-88503815-ad12-404e-94ed-0b9422bc1042 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.160667 Sep 11 00:57:02.681715 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 76/151] 10.222.0.23 () {58 vars in 1188 bytes} [Sun Sep 11 00:57:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:57:02.696925 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c8211656-636a-423c-b589-6ea7380a3bf7 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] Calling method '.version_select at 0x7fbb909a5160>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:02.824412 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c8211656-636a-423c-b589-6ea7380a3bf7 tempest-VolumesTestJSON-1562958832 tempest-VolumesTestJSON-1562958832-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.132806 Sep 11 00:57:02.825228 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 76/152] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Sep 11 00:57:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:02.930078 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-631897fb-09b9-46ad-b0fb-40d2e9308b9f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:02.930632 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-631897fb-09b9-46ad-b0fb-40d2e9308b9f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:02.940040 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-631897fb-09b9-46ad-b0fb-40d2e9308b9f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:02.940479 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-631897fb-09b9-46ad-b0fb-40d2e9308b9f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:02.943077 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-631897fb-09b9-46ad-b0fb-40d2e9308b9f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:02.944951 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-631897fb-09b9-46ad-b0fb-40d2e9308b9f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:02.945705 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-631897fb-09b9-46ad-b0fb-40d2e9308b9f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:02.947290 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-631897fb-09b9-46ad-b0fb-40d2e9308b9f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:03.050442 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e12a38f7-572d-4bd6-b0e0-7d59b4d8a7f3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:03.051121 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e12a38f7-572d-4bd6-b0e0-7d59b4d8a7f3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:03.057926 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e12a38f7-572d-4bd6-b0e0-7d59b4d8a7f3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:03.058531 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e12a38f7-572d-4bd6-b0e0-7d59b4d8a7f3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:03.059324 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e12a38f7-572d-4bd6-b0e0-7d59b4d8a7f3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:03.060245 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e12a38f7-572d-4bd6-b0e0-7d59b4d8a7f3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:03.060809 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e12a38f7-572d-4bd6-b0e0-7d59b4d8a7f3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:03.061269 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e12a38f7-572d-4bd6-b0e0-7d59b4d8a7f3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:03.172893 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e12a38f7-572d-4bd6-b0e0-7d59b4d8a7f3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:03.189450 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e12a38f7-572d-4bd6-b0e0-7d59b4d8a7f3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 200 len: 1272 microversion: 2.1 time: 0.144451 Sep 11 00:57:03.190302 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 77/153] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:03 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:03.304670 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-631897fb-09b9-46ad-b0fb-40d2e9308b9f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:03.313051 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-631897fb-09b9-46ad-b0fb-40d2e9308b9f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.387032 Sep 11 00:57:03.313793 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 77/154] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:02 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:04.215673 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9428482c-20c7-4dc8-9fc1-94ff886bb3b6 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:04.216280 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9428482c-20c7-4dc8-9fc1-94ff886bb3b6 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:04.227033 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9428482c-20c7-4dc8-9fc1-94ff886bb3b6 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:04.227579 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9428482c-20c7-4dc8-9fc1-94ff886bb3b6 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:04.228008 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9428482c-20c7-4dc8-9fc1-94ff886bb3b6 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:04.228716 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9428482c-20c7-4dc8-9fc1-94ff886bb3b6 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:04.229158 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9428482c-20c7-4dc8-9fc1-94ff886bb3b6 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:04.230472 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9428482c-20c7-4dc8-9fc1-94ff886bb3b6 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:04.339777 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-65ed1934-c944-4432-abd8-a91a6655581c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:04.340826 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-65ed1934-c944-4432-abd8-a91a6655581c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:04.347563 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-65ed1934-c944-4432-abd8-a91a6655581c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:04.348125 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-65ed1934-c944-4432-abd8-a91a6655581c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:04.348624 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-65ed1934-c944-4432-abd8-a91a6655581c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:04.349503 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-65ed1934-c944-4432-abd8-a91a6655581c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:04.350021 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-65ed1934-c944-4432-abd8-a91a6655581c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:04.350509 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-65ed1934-c944-4432-abd8-a91a6655581c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:04.554373 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-9428482c-20c7-4dc8-9fc1-94ff886bb3b6 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:04.562118 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9428482c-20c7-4dc8-9fc1-94ff886bb3b6 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 200 len: 1314 microversion: 2.1 time: 0.352560 Sep 11 00:57:04.562692 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 78/155] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:04 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:04.608702 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-52689a95-53d3-47c6-924d-f9ca5089fb6a req-5345dcc9-90a7-4fb5-b94e-b86839b96d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b02310b-372c-4121-b347-d5ccd6f86e2b", "tag": "c85344e4-f1f1-4db7-a042-68baeff0d58c"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:04.608950 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-65ed1934-c944-4432-abd8-a91a6655581c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:04.613639 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-65ed1934-c944-4432-abd8-a91a6655581c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.280632 Sep 11 00:57:04.621881 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-52689a95-53d3-47c6-924d-f9ca5089fb6a req-5345dcc9-90a7-4fb5-b94e-b86839b96d96 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:04.621881 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-52689a95-53d3-47c6-924d-f9ca5089fb6a req-5345dcc9-90a7-4fb5-b94e-b86839b96d96 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:04.621881 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-52689a95-53d3-47c6-924d-f9ca5089fb6a req-5345dcc9-90a7-4fb5-b94e-b86839b96d96 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:04.624171 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 78/156] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:04 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:04.630523 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-52689a95-53d3-47c6-924d-f9ca5089fb6a req-5345dcc9-90a7-4fb5-b94e-b86839b96d96 service nova] Creating event network-changed:c85344e4-f1f1-4db7-a042-68baeff0d58c for instance 3b02310b-372c-4121-b347-d5ccd6f86e2b on hv-cinder-maste Sep 11 00:57:04.636371 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-52689a95-53d3-47c6-924d-f9ca5089fb6a req-5345dcc9-90a7-4fb5-b94e-b86839b96d96 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036942 Sep 11 00:57:04.636951 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 79/157] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:57:05.584379 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-17476b4c-1c30-4e1f-add6-109c4bad259e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:05.584992 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-17476b4c-1c30-4e1f-add6-109c4bad259e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:05.592576 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-17476b4c-1c30-4e1f-add6-109c4bad259e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:05.593257 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-17476b4c-1c30-4e1f-add6-109c4bad259e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:05.593765 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-17476b4c-1c30-4e1f-add6-109c4bad259e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:05.594785 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-17476b4c-1c30-4e1f-add6-109c4bad259e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:05.595372 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-17476b4c-1c30-4e1f-add6-109c4bad259e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:05.595985 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-17476b4c-1c30-4e1f-add6-109c4bad259e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:05.640780 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-eea01937-fadf-4a73-812c-5be261c75551 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:05.641534 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-eea01937-fadf-4a73-812c-5be261c75551 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:05.650466 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eea01937-fadf-4a73-812c-5be261c75551 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:05.651066 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eea01937-fadf-4a73-812c-5be261c75551 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:05.651637 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eea01937-fadf-4a73-812c-5be261c75551 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:05.652470 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eea01937-fadf-4a73-812c-5be261c75551 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:05.653142 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eea01937-fadf-4a73-812c-5be261c75551 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:05.653662 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eea01937-fadf-4a73-812c-5be261c75551 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:05.797679 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-17476b4c-1c30-4e1f-add6-109c4bad259e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:05.805520 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-17476b4c-1c30-4e1f-add6-109c4bad259e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 200 len: 1314 microversion: 2.1 time: 0.224980 Sep 11 00:57:05.806173 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 79/158] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:05 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:05.826668 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-eea01937-fadf-4a73-812c-5be261c75551 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:05.834839 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-eea01937-fadf-4a73-812c-5be261c75551 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.199366 Sep 11 00:57:05.835431 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 80/159] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:05 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:06.829321 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b164fdf8-1970-4ef2-b2a7-eda041c0a9fa tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:06.830001 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-b164fdf8-1970-4ef2-b2a7-eda041c0a9fa tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:06.836666 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b164fdf8-1970-4ef2-b2a7-eda041c0a9fa tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:06.837326 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b164fdf8-1970-4ef2-b2a7-eda041c0a9fa tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:06.838676 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b164fdf8-1970-4ef2-b2a7-eda041c0a9fa tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:06.839479 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b164fdf8-1970-4ef2-b2a7-eda041c0a9fa tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:06.840157 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b164fdf8-1970-4ef2-b2a7-eda041c0a9fa tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:06.840639 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b164fdf8-1970-4ef2-b2a7-eda041c0a9fa tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:06.858122 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-280f857c-1296-42da-94fb-edbfe90148dc tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:06.858734 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-280f857c-1296-42da-94fb-edbfe90148dc tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:06.865528 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-280f857c-1296-42da-94fb-edbfe90148dc tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:06.866039 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-280f857c-1296-42da-94fb-edbfe90148dc tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:06.866456 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-280f857c-1296-42da-94fb-edbfe90148dc tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:06.867456 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-280f857c-1296-42da-94fb-edbfe90148dc tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:06.868121 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-280f857c-1296-42da-94fb-edbfe90148dc tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:06.868547 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-280f857c-1296-42da-94fb-edbfe90148dc tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:07.071451 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-b164fdf8-1970-4ef2-b2a7-eda041c0a9fa tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:07.075510 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-280f857c-1296-42da-94fb-edbfe90148dc tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:07.079617 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-b164fdf8-1970-4ef2-b2a7-eda041c0a9fa tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 200 len: 1314 microversion: 2.1 time: 0.254267 Sep 11 00:57:07.080266 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 80/160] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:06 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:07.083661 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-280f857c-1296-42da-94fb-edbfe90148dc tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.229262 Sep 11 00:57:07.084302 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 81/161] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:06 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:08.105802 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e931dc11-cefe-4a7f-a3d0-d594dc55f490 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:08.106480 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-e931dc11-cefe-4a7f-a3d0-d594dc55f490 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:08.108874 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c8cac407-12ab-4cd5-a97a-220effa54298 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:08.109547 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c8cac407-12ab-4cd5-a97a-220effa54298 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:08.114374 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e931dc11-cefe-4a7f-a3d0-d594dc55f490 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:08.114900 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e931dc11-cefe-4a7f-a3d0-d594dc55f490 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:08.115654 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e931dc11-cefe-4a7f-a3d0-d594dc55f490 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:08.116502 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e931dc11-cefe-4a7f-a3d0-d594dc55f490 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:08.116931 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8cac407-12ab-4cd5-a97a-220effa54298 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:08.117326 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e931dc11-cefe-4a7f-a3d0-d594dc55f490 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:08.117747 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8cac407-12ab-4cd5-a97a-220effa54298 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:08.117868 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e931dc11-cefe-4a7f-a3d0-d594dc55f490 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:08.119238 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8cac407-12ab-4cd5-a97a-220effa54298 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:08.120128 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8cac407-12ab-4cd5-a97a-220effa54298 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:08.120723 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8cac407-12ab-4cd5-a97a-220effa54298 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:08.121615 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8cac407-12ab-4cd5-a97a-220effa54298 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:08.131247 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:08.390041 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c8cac407-12ab-4cd5-a97a-220effa54298 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:08.391888 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-e931dc11-cefe-4a7f-a3d0-d594dc55f490 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:08.398584 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c8cac407-12ab-4cd5-a97a-220effa54298 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.294796 Sep 11 00:57:08.399199 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 82/162] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:08 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:08.424803 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-e931dc11-cefe-4a7f-a3d0-d594dc55f490 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 200 len: 1314 microversion: 2.1 time: 0.324614 Sep 11 00:57:08.425593 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 81/163] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:08 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:09.427558 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3697a37c-fe56-45dc-a551-411006845170 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:09.428610 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3697a37c-fe56-45dc-a551-411006845170 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:09.437546 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3697a37c-fe56-45dc-a551-411006845170 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:09.438251 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3697a37c-fe56-45dc-a551-411006845170 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:09.439500 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3697a37c-fe56-45dc-a551-411006845170 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:09.440384 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3697a37c-fe56-45dc-a551-411006845170 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:09.442263 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3697a37c-fe56-45dc-a551-411006845170 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:09.443529 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3697a37c-fe56-45dc-a551-411006845170 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:09.452416 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-98f01263-0521-4b38-b39f-10b753a64a1c tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:09.454568 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-98f01263-0521-4b38-b39f-10b753a64a1c tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:09.469443 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-98f01263-0521-4b38-b39f-10b753a64a1c tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:09.471443 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-98f01263-0521-4b38-b39f-10b753a64a1c tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:09.473407 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-98f01263-0521-4b38-b39f-10b753a64a1c tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:09.474830 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-98f01263-0521-4b38-b39f-10b753a64a1c tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:09.475507 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-98f01263-0521-4b38-b39f-10b753a64a1c tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:09.476774 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-98f01263-0521-4b38-b39f-10b753a64a1c tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:09.513662 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=100 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:09.724737 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3697a37c-fe56-45dc-a551-411006845170 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:09.733213 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3697a37c-fe56-45dc-a551-411006845170 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.310027 Sep 11 00:57:09.734660 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 83/164] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:09 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:09.803400 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-98f01263-0521-4b38-b39f-10b753a64a1c tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:09.811268 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-98f01263-0521-4b38-b39f-10b753a64a1c tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 200 len: 1314 microversion: 2.1 time: 0.364709 Sep 11 00:57:09.812101 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 82/165] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:09 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:10.389087 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-34a28cbe-4d83-4bfb-b72f-57ee1a157808 req-187d8ecf-997e-416c-8fee-5bd8c9a7ae8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b02310b-372c-4121-b347-d5ccd6f86e2b", "name": "network-vif-plugged", "status": "completed", "tag": "c85344e4-f1f1-4db7-a042-68baeff0d58c"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:10.400199 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-34a28cbe-4d83-4bfb-b72f-57ee1a157808 req-187d8ecf-997e-416c-8fee-5bd8c9a7ae8b service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:10.401675 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-34a28cbe-4d83-4bfb-b72f-57ee1a157808 req-187d8ecf-997e-416c-8fee-5bd8c9a7ae8b service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:10.402370 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-34a28cbe-4d83-4bfb-b72f-57ee1a157808 req-187d8ecf-997e-416c-8fee-5bd8c9a7ae8b service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:10.418093 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-34a28cbe-4d83-4bfb-b72f-57ee1a157808 req-187d8ecf-997e-416c-8fee-5bd8c9a7ae8b service nova] Creating event network-vif-plugged:c85344e4-f1f1-4db7-a042-68baeff0d58c for instance 3b02310b-372c-4121-b347-d5ccd6f86e2b on hv-cinder-maste Sep 11 00:57:10.425539 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-34a28cbe-4d83-4bfb-b72f-57ee1a157808 req-187d8ecf-997e-416c-8fee-5bd8c9a7ae8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039889 Sep 11 00:57:10.426849 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 84/166] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:57:10.756770 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c2e91848-97df-439a-8d43-63cab577cb61 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:10.757450 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c2e91848-97df-439a-8d43-63cab577cb61 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:10.763356 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2e91848-97df-439a-8d43-63cab577cb61 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:10.763843 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2e91848-97df-439a-8d43-63cab577cb61 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:10.764280 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2e91848-97df-439a-8d43-63cab577cb61 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:10.764968 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2e91848-97df-439a-8d43-63cab577cb61 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:10.765438 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2e91848-97df-439a-8d43-63cab577cb61 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:10.765853 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2e91848-97df-439a-8d43-63cab577cb61 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:10.766273 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=2 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:10.786806 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=6 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:10.836214 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fef9cee1-4639-4c2f-ac34-87ecf849567e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:10.836997 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-fef9cee1-4639-4c2f-ac34-87ecf849567e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:10.844882 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fef9cee1-4639-4c2f-ac34-87ecf849567e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:10.845458 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fef9cee1-4639-4c2f-ac34-87ecf849567e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:10.846877 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fef9cee1-4639-4c2f-ac34-87ecf849567e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:10.847708 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fef9cee1-4639-4c2f-ac34-87ecf849567e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:10.848294 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fef9cee1-4639-4c2f-ac34-87ecf849567e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:10.849461 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fef9cee1-4639-4c2f-ac34-87ecf849567e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:10.915551 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:10.958403 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c2e91848-97df-439a-8d43-63cab577cb61 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:10.966360 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c2e91848-97df-439a-8d43-63cab577cb61 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.213495 Sep 11 00:57:10.966937 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 83/167] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:10 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:11.019470 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-fef9cee1-4639-4c2f-ac34-87ecf849567e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:11.027505 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-fef9cee1-4639-4c2f-ac34-87ecf849567e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 200 len: 1314 microversion: 2.1 time: 0.196302 Sep 11 00:57:11.028085 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 85/168] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:10 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:11.992745 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-284df760-ac46-4445-a25e-99f539b0b34a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:11.993280 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-284df760-ac46-4445-a25e-99f539b0b34a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:11.999682 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-284df760-ac46-4445-a25e-99f539b0b34a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:12.000168 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-284df760-ac46-4445-a25e-99f539b0b34a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:12.000604 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-284df760-ac46-4445-a25e-99f539b0b34a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:12.001282 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-284df760-ac46-4445-a25e-99f539b0b34a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:12.001727 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-284df760-ac46-4445-a25e-99f539b0b34a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:12.002145 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-284df760-ac46-4445-a25e-99f539b0b34a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:12.053666 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-dd5ea2e7-4ec7-4864-bdb9-a7085920b800 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:12.054407 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-dd5ea2e7-4ec7-4864-bdb9-a7085920b800 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:12.061221 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dd5ea2e7-4ec7-4864-bdb9-a7085920b800 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:12.061702 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dd5ea2e7-4ec7-4864-bdb9-a7085920b800 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:12.062132 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dd5ea2e7-4ec7-4864-bdb9-a7085920b800 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:12.062851 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dd5ea2e7-4ec7-4864-bdb9-a7085920b800 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:12.064191 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dd5ea2e7-4ec7-4864-bdb9-a7085920b800 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:12.064640 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dd5ea2e7-4ec7-4864-bdb9-a7085920b800 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:12.190956 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-284df760-ac46-4445-a25e-99f539b0b34a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:12.215714 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-284df760-ac46-4445-a25e-99f539b0b34a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.227266 Sep 11 00:57:12.226903 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 84/169] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:11 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:12.237369 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-dd5ea2e7-4ec7-4864-bdb9-a7085920b800 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:12.246916 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-dd5ea2e7-4ec7-4864-bdb9-a7085920b800 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 200 len: 1314 microversion: 2.1 time: 0.198631 Sep 11 00:57:12.247534 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 86/170] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:12 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:13.238285 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-76714f10-bcfb-4bdc-aa6f-1ab3973ce849 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:13.238828 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-76714f10-bcfb-4bdc-aa6f-1ab3973ce849 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:13.245406 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-76714f10-bcfb-4bdc-aa6f-1ab3973ce849 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:13.245879 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-76714f10-bcfb-4bdc-aa6f-1ab3973ce849 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:13.246302 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-76714f10-bcfb-4bdc-aa6f-1ab3973ce849 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:13.246978 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-76714f10-bcfb-4bdc-aa6f-1ab3973ce849 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:13.247455 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-76714f10-bcfb-4bdc-aa6f-1ab3973ce849 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:13.247900 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-76714f10-bcfb-4bdc-aa6f-1ab3973ce849 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:13.270622 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-885f97ab-e37e-4243-8f79-87c715920557 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:13.271365 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-885f97ab-e37e-4243-8f79-87c715920557 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:13.278579 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-885f97ab-e37e-4243-8f79-87c715920557 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:13.279299 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-885f97ab-e37e-4243-8f79-87c715920557 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:13.279986 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-885f97ab-e37e-4243-8f79-87c715920557 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:13.280910 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-885f97ab-e37e-4243-8f79-87c715920557 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:13.281404 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-885f97ab-e37e-4243-8f79-87c715920557 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:13.281946 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-885f97ab-e37e-4243-8f79-87c715920557 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:13.441258 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-76714f10-bcfb-4bdc-aa6f-1ab3973ce849 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:13.450509 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-76714f10-bcfb-4bdc-aa6f-1ab3973ce849 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.216247 Sep 11 00:57:13.462862 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 85/171] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:13 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:13.469328 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-885f97ab-e37e-4243-8f79-87c715920557 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:13.477131 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-885f97ab-e37e-4243-8f79-87c715920557 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 200 len: 1498 microversion: 2.1 time: 0.210465 Sep 11 00:57:13.478082 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 87/172] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:13 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 1498 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:14.225029 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f45cb80a-299f-4c7e-a774-3026d3f79ad3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:14.225524 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f45cb80a-299f-4c7e-a774-3026d3f79ad3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:14.232494 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f45cb80a-299f-4c7e-a774-3026d3f79ad3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:14.232978 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f45cb80a-299f-4c7e-a774-3026d3f79ad3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:14.233412 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f45cb80a-299f-4c7e-a774-3026d3f79ad3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:14.234098 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f45cb80a-299f-4c7e-a774-3026d3f79ad3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:14.234542 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f45cb80a-299f-4c7e-a774-3026d3f79ad3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:14.234955 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f45cb80a-299f-4c7e-a774-3026d3f79ad3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:14.260614 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f45cb80a-299f-4c7e-a774-3026d3f79ad3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Going to try to terminate instance {{(pid=120497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:57:14.346629 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f45cb80a-299f-4c7e-a774-3026d3f79ad3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 204 len: 0 microversion: 2.1 time: 0.125589 Sep 11 00:57:14.347606 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 86/173] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 00:57:14 2022] DELETE /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:57:14.359202 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9e361cb6-0b9f-4b18-83bd-7c415d86da59 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:14.359859 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9e361cb6-0b9f-4b18-83bd-7c415d86da59 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:14.368148 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9e361cb6-0b9f-4b18-83bd-7c415d86da59 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:14.368993 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9e361cb6-0b9f-4b18-83bd-7c415d86da59 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:14.369536 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9e361cb6-0b9f-4b18-83bd-7c415d86da59 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:14.370330 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9e361cb6-0b9f-4b18-83bd-7c415d86da59 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:14.370775 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9e361cb6-0b9f-4b18-83bd-7c415d86da59 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:14.371207 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9e361cb6-0b9f-4b18-83bd-7c415d86da59 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:14.473786 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-27b18093-1acc-46b3-9816-a53e3272899c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:14.474511 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-27b18093-1acc-46b3-9816-a53e3272899c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:14.481394 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-27b18093-1acc-46b3-9816-a53e3272899c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:14.481889 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-27b18093-1acc-46b3-9816-a53e3272899c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:14.482313 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-27b18093-1acc-46b3-9816-a53e3272899c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:14.483007 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-27b18093-1acc-46b3-9816-a53e3272899c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:14.483482 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-27b18093-1acc-46b3-9816-a53e3272899c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:14.483899 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-27b18093-1acc-46b3-9816-a53e3272899c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:14.511501 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-9e361cb6-0b9f-4b18-83bd-7c415d86da59 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:14.526157 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9e361cb6-0b9f-4b18-83bd-7c415d86da59 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 200 len: 1504 microversion: 2.1 time: 0.172945 Sep 11 00:57:14.526630 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 88/174] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:14 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:14.625146 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-27b18093-1acc-46b3-9816-a53e3272899c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:14.632955 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-27b18093-1acc-46b3-9816-a53e3272899c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.163499 Sep 11 00:57:14.633533 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 87/175] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:14 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:15.561184 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-dc18bd65-fa62-4e2a-ac30-db27ccc83482 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:15.562193 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-dc18bd65-fa62-4e2a-ac30-db27ccc83482 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:15.570921 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc18bd65-fa62-4e2a-ac30-db27ccc83482 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:15.571631 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc18bd65-fa62-4e2a-ac30-db27ccc83482 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:15.572050 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc18bd65-fa62-4e2a-ac30-db27ccc83482 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:15.572831 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc18bd65-fa62-4e2a-ac30-db27ccc83482 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:15.573238 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc18bd65-fa62-4e2a-ac30-db27ccc83482 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:15.573638 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc18bd65-fa62-4e2a-ac30-db27ccc83482 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:15.656987 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-1f97c5bb-d36a-4fe6-90b2-9778a434406d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:15.657833 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-1f97c5bb-d36a-4fe6-90b2-9778a434406d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:15.665278 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1f97c5bb-d36a-4fe6-90b2-9778a434406d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:15.665886 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1f97c5bb-d36a-4fe6-90b2-9778a434406d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:15.666354 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1f97c5bb-d36a-4fe6-90b2-9778a434406d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:15.667005 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1f97c5bb-d36a-4fe6-90b2-9778a434406d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:15.667475 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1f97c5bb-d36a-4fe6-90b2-9778a434406d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:15.667890 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1f97c5bb-d36a-4fe6-90b2-9778a434406d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:15.719083 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-dc18bd65-fa62-4e2a-ac30-db27ccc83482 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:15.727634 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-dc18bd65-fa62-4e2a-ac30-db27ccc83482 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 200 len: 1504 microversion: 2.1 time: 0.180295 Sep 11 00:57:15.728235 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 89/176] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:15 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:15.809057 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1f97c5bb-d36a-4fe6-90b2-9778a434406d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:15.817976 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-1f97c5bb-d36a-4fe6-90b2-9778a434406d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.165178 Sep 11 00:57:15.818544 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 88/177] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:15 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:16.750562 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-745b6d32-81b4-42bb-b9c9-9e6ee7221662 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:16.751211 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-745b6d32-81b4-42bb-b9c9-9e6ee7221662 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:16.758056 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-745b6d32-81b4-42bb-b9c9-9e6ee7221662 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:16.759669 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-745b6d32-81b4-42bb-b9c9-9e6ee7221662 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:16.760136 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-745b6d32-81b4-42bb-b9c9-9e6ee7221662 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:16.760876 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-745b6d32-81b4-42bb-b9c9-9e6ee7221662 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:16.761523 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-745b6d32-81b4-42bb-b9c9-9e6ee7221662 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:16.762099 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-745b6d32-81b4-42bb-b9c9-9e6ee7221662 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:16.841103 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c0cbe51b-594f-4304-9c8f-114ff12161da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:16.841695 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c0cbe51b-594f-4304-9c8f-114ff12161da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:16.847600 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0cbe51b-594f-4304-9c8f-114ff12161da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:16.848081 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0cbe51b-594f-4304-9c8f-114ff12161da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:16.848514 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0cbe51b-594f-4304-9c8f-114ff12161da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:16.849206 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0cbe51b-594f-4304-9c8f-114ff12161da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:16.849655 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0cbe51b-594f-4304-9c8f-114ff12161da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:16.850084 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0cbe51b-594f-4304-9c8f-114ff12161da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:17.025166 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-745b6d32-81b4-42bb-b9c9-9e6ee7221662 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:17.034741 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-745b6d32-81b4-42bb-b9c9-9e6ee7221662 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 200 len: 1504 microversion: 2.1 time: 0.288063 Sep 11 00:57:17.040208 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 90/178] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:16 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:17.045671 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-3e9d8b71-5519-4039-97ad-81a5608c81c8 req-5b14597f-a3ea-47f3-b403-c265f2c389d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b02310b-372c-4121-b347-d5ccd6f86e2b", "name": "network-vif-deleted", "tag": "c85344e4-f1f1-4db7-a042-68baeff0d58c"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:17.057566 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3e9d8b71-5519-4039-97ad-81a5608c81c8 req-5b14597f-a3ea-47f3-b403-c265f2c389d6 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:17.058627 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3e9d8b71-5519-4039-97ad-81a5608c81c8 req-5b14597f-a3ea-47f3-b403-c265f2c389d6 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:17.059270 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3e9d8b71-5519-4039-97ad-81a5608c81c8 req-5b14597f-a3ea-47f3-b403-c265f2c389d6 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:17.071738 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-3e9d8b71-5519-4039-97ad-81a5608c81c8 req-5b14597f-a3ea-47f3-b403-c265f2c389d6 service nova] Creating event network-vif-deleted:c85344e4-f1f1-4db7-a042-68baeff0d58c for instance 3b02310b-372c-4121-b347-d5ccd6f86e2b on hv-cinder-maste Sep 11 00:57:17.076826 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-3e9d8b71-5519-4039-97ad-81a5608c81c8 req-5b14597f-a3ea-47f3-b403-c265f2c389d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036088 Sep 11 00:57:17.077620 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 91/179] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:57:17.084192 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c0cbe51b-594f-4304-9c8f-114ff12161da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:17.092661 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c0cbe51b-594f-4304-9c8f-114ff12161da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.255460 Sep 11 00:57:17.093328 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 89/180] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:16 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:18.068386 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f0a61875-6246-449f-a89e-b1f8f096ee17 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:18.069072 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f0a61875-6246-449f-a89e-b1f8f096ee17 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 3b02310b-372c-4121-b347-d5ccd6f86e2b] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:18.076610 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f0a61875-6246-449f-a89e-b1f8f096ee17 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:18.077081 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f0a61875-6246-449f-a89e-b1f8f096ee17 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:18.077503 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f0a61875-6246-449f-a89e-b1f8f096ee17 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:18.078212 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f0a61875-6246-449f-a89e-b1f8f096ee17 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:18.078655 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f0a61875-6246-449f-a89e-b1f8f096ee17 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:18.079067 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f0a61875-6246-449f-a89e-b1f8f096ee17 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:18.093214 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-f0a61875-6246-449f-a89e-b1f8f096ee17 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] HTTP exception thrown: Instance 3b02310b-372c-4121-b347-d5ccd6f86e2b could not be found. Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f0a61875-6246-449f-a89e-b1f8f096ee17 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Request method failure captured: Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b HTTP/1.1 Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTJaba2z73QklZAa8dZkfDf0vyYtK1lT38zsN_45eH2p_y2XJcwnwNWxV8CTNY_2wVI-3VTpViAiLF9Fxo5ViTxOAgEZoGBLeEsCjQnuvwmqECD_kSPRBtphwPksc95fDgDZRGPOWE71ilJycfk5HjIYh09796kzEkPDnRgoFx0OAwM Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: a84206f4832a4edda41c06ab2178c9a5 Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesActionsTest-1638871891 Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 00:57:18.094870 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 00:57:18.096396 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a84206f4832a4edda41c06ab2178c9a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a84206f4832a4edda41c06ab2178c9a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a84206f4832a4edda41c06ab2178c9a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a84206f4832a4edda41c06ab2178c9a5", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:57:18.096396 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-VolumesActionsTest-1638871891 Sep 11 00:57:18.096396 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: a84206f4832a4edda41c06ab2178c9a5 Sep 11 00:57:18.096396 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesActionsTest-1638871891 Sep 11 00:57:18.096396 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-VolumesActionsTest-1638871891-project Sep 11 00:57:18.096396 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 00:57:18.096396 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 00:57:18.096396 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 398da9e11a194b9f9644dfad517d07b4 Sep 11 00:57:18.096396 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-VolumesActionsTest-1638871891-project Sep 11 00:57:18.096396 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 00:57:18.096396 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance 3b02310b-372c-4121-b347-d5ccd6f86e2b could not be found. Sep 11 00:57:18.096396 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': '3b02310b-372c-4121-b347-d5ccd6f86e2b'} Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b02310b-372c-4121-b347-d5ccd6f86e2b could not be found. Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:57:18.097311 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b02310b-372c-4121-b347-d5ccd6f86e2b could not be found. Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b02310b-372c-4121-b347-d5ccd6f86e2b could not be found. Sep 11 00:57:18.098751 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:57:18.099994 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f0a61875-6246-449f-a89e-b1f8f096ee17 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Returning 404 to user: Instance 3b02310b-372c-4121-b347-d5ccd6f86e2b could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:57:18.099994 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f0a61875-6246-449f-a89e-b1f8f096ee17 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b" status: 404 len: 111 microversion: 2.1 time: 0.033297 Sep 11 00:57:18.099994 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 92/181] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:18 2022] GET /compute/v2.1/servers/3b02310b-372c-4121-b347-d5ccd6f86e2b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:57:18.115538 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-06b1aa88-b2bc-47f4-a3ce-fa9b41c76944 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:18.116695 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-06b1aa88-b2bc-47f4-a3ce-fa9b41c76944 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:18.123585 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-06b1aa88-b2bc-47f4-a3ce-fa9b41c76944 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:18.124063 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-06b1aa88-b2bc-47f4-a3ce-fa9b41c76944 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:18.124495 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-06b1aa88-b2bc-47f4-a3ce-fa9b41c76944 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:18.125240 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-06b1aa88-b2bc-47f4-a3ce-fa9b41c76944 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:18.125619 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-06b1aa88-b2bc-47f4-a3ce-fa9b41c76944 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:18.126088 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-06b1aa88-b2bc-47f4-a3ce-fa9b41c76944 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:18.202558 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2077072311", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "networks": [{"uuid": "6ccc5063-a369-45c1-8051-9a94c49384ca"}]}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:18.258049 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] validate_networks() for [('6ccc5063-a369-45c1-8051-9a94c49384ca', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:57:18.261362 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-06b1aa88-b2bc-47f4-a3ce-fa9b41c76944 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:18.269426 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-06b1aa88-b2bc-47f4-a3ce-fa9b41c76944 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.157850 Sep 11 00:57:18.270019 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 90/182] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:18 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:18.820829 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:57:18.821244 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:57:18.821694 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:57:18.822116 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:57:18.822662 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:57:18.831291 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:18.831776 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:18.832178 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:18.832893 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:18.833333 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:18.833741 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:18.850129 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Getting quotas for project a84206f4832a4edda41c06ab2178c9a5. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:57:18.854080 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Getting quotas for user 398da9e11a194b9f9644dfad517d07b4 and project a84206f4832a4edda41c06ab2178c9a5. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:57:18.865742 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:57:18.868091 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:57:18.879721 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=66 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:18.918357 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0f712685-3b8f-46fc-b6db-9a46090cc885 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719959 Sep 11 00:57:18.919598 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 93/183] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 00:57:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 00:57:18.939594 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a4b00eb2-1844-42c9-a02b-5b8da3b76b42 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:18.939594 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a4b00eb2-1844-42c9-a02b-5b8da3b76b42 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:18.993453 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a4b00eb2-1844-42c9-a02b-5b8da3b76b42 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:19.008803 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a4b00eb2-1844-42c9-a02b-5b8da3b76b42 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 200 len: 1214 microversion: 2.1 time: 0.081854 Sep 11 00:57:19.015648 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 91/184] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:18 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:19.296234 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d2508483-065f-4ff0-a184-800b2221e772 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:19.297738 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d2508483-065f-4ff0-a184-800b2221e772 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:19.320440 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2508483-065f-4ff0-a184-800b2221e772 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:19.324264 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2508483-065f-4ff0-a184-800b2221e772 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:19.325180 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2508483-065f-4ff0-a184-800b2221e772 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:19.325936 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2508483-065f-4ff0-a184-800b2221e772 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:19.326691 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2508483-065f-4ff0-a184-800b2221e772 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:19.327419 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2508483-065f-4ff0-a184-800b2221e772 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:19.491616 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-d2508483-065f-4ff0-a184-800b2221e772 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:19.500044 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d2508483-065f-4ff0-a184-800b2221e772 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.210595 Sep 11 00:57:19.500679 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 94/185] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:19 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:20.033320 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a91efbf8-f576-437a-8760-919895ce8468 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:20.033885 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a91efbf8-f576-437a-8760-919895ce8468 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:20.040551 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a91efbf8-f576-437a-8760-919895ce8468 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:20.041026 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a91efbf8-f576-437a-8760-919895ce8468 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:20.041449 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a91efbf8-f576-437a-8760-919895ce8468 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:20.042127 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a91efbf8-f576-437a-8760-919895ce8468 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:20.042567 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a91efbf8-f576-437a-8760-919895ce8468 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:20.043009 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a91efbf8-f576-437a-8760-919895ce8468 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:20.107984 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a91efbf8-f576-437a-8760-919895ce8468 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:20.115978 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a91efbf8-f576-437a-8760-919895ce8468 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 200 len: 1266 microversion: 2.1 time: 0.087051 Sep 11 00:57:20.116548 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 92/186] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:20 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:20.524578 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b92be5e5-6da8-4ed9-8a28-92d8c05480bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:20.525405 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b92be5e5-6da8-4ed9-8a28-92d8c05480bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:20.532284 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b92be5e5-6da8-4ed9-8a28-92d8c05480bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:20.532798 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b92be5e5-6da8-4ed9-8a28-92d8c05480bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:20.533234 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b92be5e5-6da8-4ed9-8a28-92d8c05480bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:20.533928 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b92be5e5-6da8-4ed9-8a28-92d8c05480bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:20.534373 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b92be5e5-6da8-4ed9-8a28-92d8c05480bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:20.534790 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b92be5e5-6da8-4ed9-8a28-92d8c05480bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:20.766295 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b92be5e5-6da8-4ed9-8a28-92d8c05480bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:20.776139 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b92be5e5-6da8-4ed9-8a28-92d8c05480bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.256381 Sep 11 00:57:20.776732 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 95/187] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:20 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:21.138917 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d5af21da-f758-432d-8afa-e34c436f6204 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:21.140633 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d5af21da-f758-432d-8afa-e34c436f6204 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:21.147664 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d5af21da-f758-432d-8afa-e34c436f6204 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:21.148206 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d5af21da-f758-432d-8afa-e34c436f6204 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:21.148595 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d5af21da-f758-432d-8afa-e34c436f6204 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:21.149292 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d5af21da-f758-432d-8afa-e34c436f6204 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:21.149765 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d5af21da-f758-432d-8afa-e34c436f6204 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:21.150518 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d5af21da-f758-432d-8afa-e34c436f6204 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:21.350534 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d5af21da-f758-432d-8afa-e34c436f6204 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:21.358554 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d5af21da-f758-432d-8afa-e34c436f6204 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 200 len: 1314 microversion: 2.1 time: 0.223568 Sep 11 00:57:21.359133 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 93/188] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:21 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:21.801395 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-63f0cfe1-475a-45ce-97cf-14093d302c48 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:21.802769 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-63f0cfe1-475a-45ce-97cf-14093d302c48 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:21.812564 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-63f0cfe1-475a-45ce-97cf-14093d302c48 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:21.813427 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-63f0cfe1-475a-45ce-97cf-14093d302c48 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:21.814202 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-63f0cfe1-475a-45ce-97cf-14093d302c48 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:21.815111 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-63f0cfe1-475a-45ce-97cf-14093d302c48 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:21.815785 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-63f0cfe1-475a-45ce-97cf-14093d302c48 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:21.816408 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-63f0cfe1-475a-45ce-97cf-14093d302c48 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:22.028802 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-63f0cfe1-475a-45ce-97cf-14093d302c48 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:22.038160 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-63f0cfe1-475a-45ce-97cf-14093d302c48 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.242377 Sep 11 00:57:22.039124 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 96/189] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:21 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:22.063630 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-6c8f7a42-0e33-4ec1-acef-a93a188de216 req-f7bfc54c-69f7-4387-866b-94206d223c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87320013-f620-4622-bc86-a9269a349f34", "tag": "84753a51-1962-48c6-b812-f690c22d1ce7"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:22.075929 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:22.078709 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-6c8f7a42-0e33-4ec1-acef-a93a188de216 req-f7bfc54c-69f7-4387-866b-94206d223c19 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:22.079395 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-6c8f7a42-0e33-4ec1-acef-a93a188de216 req-f7bfc54c-69f7-4387-866b-94206d223c19 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:22.080178 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-6c8f7a42-0e33-4ec1-acef-a93a188de216 req-f7bfc54c-69f7-4387-866b-94206d223c19 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:22.092538 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-6c8f7a42-0e33-4ec1-acef-a93a188de216 req-f7bfc54c-69f7-4387-866b-94206d223c19 service nova] Creating event network-changed:84753a51-1962-48c6-b812-f690c22d1ce7 for instance 87320013-f620-4622-bc86-a9269a349f34 on hv-cinder-maste Sep 11 00:57:22.097748 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-6c8f7a42-0e33-4ec1-acef-a93a188de216 req-f7bfc54c-69f7-4387-866b-94206d223c19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040387 Sep 11 00:57:22.098512 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 94/190] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:57:22.381369 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-94627e4d-89b2-4cfa-b17b-19524890521e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:22.381971 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-94627e4d-89b2-4cfa-b17b-19524890521e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:22.388489 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-94627e4d-89b2-4cfa-b17b-19524890521e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:22.388970 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-94627e4d-89b2-4cfa-b17b-19524890521e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:22.389405 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-94627e4d-89b2-4cfa-b17b-19524890521e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:22.390081 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-94627e4d-89b2-4cfa-b17b-19524890521e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:22.390606 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-94627e4d-89b2-4cfa-b17b-19524890521e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:22.391023 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-94627e4d-89b2-4cfa-b17b-19524890521e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:22.598260 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-94627e4d-89b2-4cfa-b17b-19524890521e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:22.606382 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-94627e4d-89b2-4cfa-b17b-19524890521e tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 200 len: 1314 microversion: 2.1 time: 0.228835 Sep 11 00:57:22.606926 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 97/191] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:22 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:23.063821 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5619f69a-7075-4968-88c4-b367516930ba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:23.064514 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-5619f69a-7075-4968-88c4-b367516930ba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:23.072449 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5619f69a-7075-4968-88c4-b367516930ba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:23.072449 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5619f69a-7075-4968-88c4-b367516930ba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:23.072449 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5619f69a-7075-4968-88c4-b367516930ba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:23.072816 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5619f69a-7075-4968-88c4-b367516930ba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:23.073422 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5619f69a-7075-4968-88c4-b367516930ba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:23.073845 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5619f69a-7075-4968-88c4-b367516930ba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:23.240593 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-5619f69a-7075-4968-88c4-b367516930ba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:23.248830 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-5619f69a-7075-4968-88c4-b367516930ba tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.190603 Sep 11 00:57:23.249406 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 95/192] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:23 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:23.630764 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-33096b90-4dba-4c3e-981f-e746b3492f85 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:23.631387 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-33096b90-4dba-4c3e-981f-e746b3492f85 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:23.638694 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33096b90-4dba-4c3e-981f-e746b3492f85 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:23.639218 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33096b90-4dba-4c3e-981f-e746b3492f85 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:23.639685 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33096b90-4dba-4c3e-981f-e746b3492f85 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:23.640414 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33096b90-4dba-4c3e-981f-e746b3492f85 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:23.640887 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33096b90-4dba-4c3e-981f-e746b3492f85 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:23.641374 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33096b90-4dba-4c3e-981f-e746b3492f85 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:23.819617 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-33096b90-4dba-4c3e-981f-e746b3492f85 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:23.827317 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-33096b90-4dba-4c3e-981f-e746b3492f85 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 200 len: 1314 microversion: 2.1 time: 0.200876 Sep 11 00:57:23.828032 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 98/193] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:23 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:24.272349 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-4b3eef40-67db-45e3-84e8-8340d3454a3c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:24.272956 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-4b3eef40-67db-45e3-84e8-8340d3454a3c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:24.279369 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4b3eef40-67db-45e3-84e8-8340d3454a3c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:24.280000 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4b3eef40-67db-45e3-84e8-8340d3454a3c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:24.280529 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4b3eef40-67db-45e3-84e8-8340d3454a3c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:24.281521 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4b3eef40-67db-45e3-84e8-8340d3454a3c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:24.282027 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4b3eef40-67db-45e3-84e8-8340d3454a3c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:24.282451 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4b3eef40-67db-45e3-84e8-8340d3454a3c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:24.516008 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-4b3eef40-67db-45e3-84e8-8340d3454a3c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:24.523919 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-4b3eef40-67db-45e3-84e8-8340d3454a3c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.255575 Sep 11 00:57:24.539543 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 96/194] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:24 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:24.850605 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bc674383-a804-4143-88b2-4d9918df25c9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:24.851406 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bc674383-a804-4143-88b2-4d9918df25c9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:24.860432 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc674383-a804-4143-88b2-4d9918df25c9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:24.861006 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc674383-a804-4143-88b2-4d9918df25c9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:24.861436 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc674383-a804-4143-88b2-4d9918df25c9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:24.862124 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc674383-a804-4143-88b2-4d9918df25c9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:24.862572 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc674383-a804-4143-88b2-4d9918df25c9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:24.862994 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc674383-a804-4143-88b2-4d9918df25c9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:24.995778 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-bc674383-a804-4143-88b2-4d9918df25c9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:25.003738 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bc674383-a804-4143-88b2-4d9918df25c9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 200 len: 1314 microversion: 2.1 time: 0.157602 Sep 11 00:57:25.004378 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 99/195] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:24 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:25.549040 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c291a106-ceb8-49eb-a4e2-17564730034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:25.549583 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c291a106-ceb8-49eb-a4e2-17564730034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:25.556109 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c291a106-ceb8-49eb-a4e2-17564730034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:25.556596 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c291a106-ceb8-49eb-a4e2-17564730034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:25.557008 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c291a106-ceb8-49eb-a4e2-17564730034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:25.557939 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c291a106-ceb8-49eb-a4e2-17564730034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:25.558519 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c291a106-ceb8-49eb-a4e2-17564730034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:25.558945 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c291a106-ceb8-49eb-a4e2-17564730034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:25.694499 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c291a106-ceb8-49eb-a4e2-17564730034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:25.703208 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c291a106-ceb8-49eb-a4e2-17564730034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.158299 Sep 11 00:57:25.703810 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 97/196] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:25 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:26.028392 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ba38392a-2440-4f13-8cc2-e32069bff7ae tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:26.029908 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ba38392a-2440-4f13-8cc2-e32069bff7ae tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:26.037257 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba38392a-2440-4f13-8cc2-e32069bff7ae tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:26.037759 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba38392a-2440-4f13-8cc2-e32069bff7ae tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:26.038185 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba38392a-2440-4f13-8cc2-e32069bff7ae tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:26.038890 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba38392a-2440-4f13-8cc2-e32069bff7ae tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:26.039369 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba38392a-2440-4f13-8cc2-e32069bff7ae tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:26.039785 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba38392a-2440-4f13-8cc2-e32069bff7ae tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:26.223058 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-ba38392a-2440-4f13-8cc2-e32069bff7ae tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:26.232238 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ba38392a-2440-4f13-8cc2-e32069bff7ae tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 200 len: 1314 microversion: 2.1 time: 0.209571 Sep 11 00:57:26.232832 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 100/197] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:26 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:26.484946 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-8135ca55-66cd-4e9a-868e-ae3b87451791 req-76d5f198-324e-4c80-8c53-26225dda7c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87320013-f620-4622-bc86-a9269a349f34", "name": "network-vif-plugged", "status": "completed", "tag": "84753a51-1962-48c6-b812-f690c22d1ce7"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:26.497030 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-8135ca55-66cd-4e9a-868e-ae3b87451791 req-76d5f198-324e-4c80-8c53-26225dda7c3f service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:26.497587 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-8135ca55-66cd-4e9a-868e-ae3b87451791 req-76d5f198-324e-4c80-8c53-26225dda7c3f service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:26.497988 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-8135ca55-66cd-4e9a-868e-ae3b87451791 req-76d5f198-324e-4c80-8c53-26225dda7c3f service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:26.511641 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-8135ca55-66cd-4e9a-868e-ae3b87451791 req-76d5f198-324e-4c80-8c53-26225dda7c3f service nova] Creating event network-vif-plugged:84753a51-1962-48c6-b812-f690c22d1ce7 for instance 87320013-f620-4622-bc86-a9269a349f34 on hv-cinder-maste Sep 11 00:57:26.516845 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-8135ca55-66cd-4e9a-868e-ae3b87451791 req-76d5f198-324e-4c80-8c53-26225dda7c3f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036702 Sep 11 00:57:26.517465 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 98/198] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:57:26.726286 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1e57e6bb-76fa-49d1-8cbd-16ca45d920fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:26.727064 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1e57e6bb-76fa-49d1-8cbd-16ca45d920fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:26.733247 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e57e6bb-76fa-49d1-8cbd-16ca45d920fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:26.733799 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e57e6bb-76fa-49d1-8cbd-16ca45d920fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:26.734267 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e57e6bb-76fa-49d1-8cbd-16ca45d920fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:26.735047 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e57e6bb-76fa-49d1-8cbd-16ca45d920fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:26.735565 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e57e6bb-76fa-49d1-8cbd-16ca45d920fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:26.735986 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e57e6bb-76fa-49d1-8cbd-16ca45d920fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:26.752299 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:27.089380 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1e57e6bb-76fa-49d1-8cbd-16ca45d920fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:27.102096 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1e57e6bb-76fa-49d1-8cbd-16ca45d920fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1521 microversion: 2.1 time: 0.379435 Sep 11 00:57:27.102795 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 101/199] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:26 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:27.255047 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a70b5bb3-0900-4e54-b036-e4375a6ff982 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:27.256011 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a70b5bb3-0900-4e54-b036-e4375a6ff982 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:27.262946 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a70b5bb3-0900-4e54-b036-e4375a6ff982 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:27.263567 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a70b5bb3-0900-4e54-b036-e4375a6ff982 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:27.264068 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a70b5bb3-0900-4e54-b036-e4375a6ff982 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:27.264934 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a70b5bb3-0900-4e54-b036-e4375a6ff982 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:27.265547 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a70b5bb3-0900-4e54-b036-e4375a6ff982 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:27.266133 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a70b5bb3-0900-4e54-b036-e4375a6ff982 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:27.410732 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a70b5bb3-0900-4e54-b036-e4375a6ff982 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:27.417100 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:27.419755 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a70b5bb3-0900-4e54-b036-e4375a6ff982 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 200 len: 1314 microversion: 2.1 time: 0.169297 Sep 11 00:57:27.420906 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 99/200] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:27 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:28.125485 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e1cc4f35-8bcd-4978-a732-e6136c25a58c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:28.126180 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e1cc4f35-8bcd-4978-a732-e6136c25a58c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:28.133201 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1cc4f35-8bcd-4978-a732-e6136c25a58c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:28.133976 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1cc4f35-8bcd-4978-a732-e6136c25a58c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:28.134516 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1cc4f35-8bcd-4978-a732-e6136c25a58c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:28.135552 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1cc4f35-8bcd-4978-a732-e6136c25a58c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:28.136099 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1cc4f35-8bcd-4978-a732-e6136c25a58c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:28.136584 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1cc4f35-8bcd-4978-a732-e6136c25a58c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:28.277452 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e1cc4f35-8bcd-4978-a732-e6136c25a58c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:28.285606 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e1cc4f35-8bcd-4978-a732-e6136c25a58c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1501 microversion: 2.1 time: 0.164269 Sep 11 00:57:28.286267 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 102/201] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:28 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:28.309296 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ffffcbff-df17-471f-a41e-7fdf6386034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:28.309998 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ffffcbff-df17-471f-a41e-7fdf6386034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:28.318733 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ffffcbff-df17-471f-a41e-7fdf6386034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:28.322938 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ffffcbff-df17-471f-a41e-7fdf6386034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:28.326984 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ffffcbff-df17-471f-a41e-7fdf6386034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:28.328335 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ffffcbff-df17-471f-a41e-7fdf6386034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:28.328978 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ffffcbff-df17-471f-a41e-7fdf6386034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:28.329655 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ffffcbff-df17-471f-a41e-7fdf6386034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:28.451337 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8ab4131c-54fd-4875-bb32-1ba4aeda52f9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:28.451952 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8ab4131c-54fd-4875-bb32-1ba4aeda52f9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:28.461256 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8ab4131c-54fd-4875-bb32-1ba4aeda52f9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:28.461744 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8ab4131c-54fd-4875-bb32-1ba4aeda52f9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:28.462175 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8ab4131c-54fd-4875-bb32-1ba4aeda52f9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:28.462860 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8ab4131c-54fd-4875-bb32-1ba4aeda52f9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:28.463838 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8ab4131c-54fd-4875-bb32-1ba4aeda52f9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:28.464379 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8ab4131c-54fd-4875-bb32-1ba4aeda52f9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:28.468846 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ffffcbff-df17-471f-a41e-7fdf6386034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:28.477296 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ffffcbff-df17-471f-a41e-7fdf6386034c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1514 microversion: 2.1 time: 0.172372 Sep 11 00:57:28.478202 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 100/202] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:28 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:28.614786 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8ab4131c-54fd-4875-bb32-1ba4aeda52f9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:28.622780 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8ab4131c-54fd-4875-bb32-1ba4aeda52f9 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 200 len: 1314 microversion: 2.1 time: 0.177235 Sep 11 00:57:28.623544 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 103/203] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:28 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:29.645033 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8f64f1a2-0dbd-4bc9-9296-8993dce86cf3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:29.645644 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-8f64f1a2-0dbd-4bc9-9296-8993dce86cf3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:29.647577 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=2 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:29.653061 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8f64f1a2-0dbd-4bc9-9296-8993dce86cf3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:29.653532 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8f64f1a2-0dbd-4bc9-9296-8993dce86cf3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:29.653954 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8f64f1a2-0dbd-4bc9-9296-8993dce86cf3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:29.654633 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8f64f1a2-0dbd-4bc9-9296-8993dce86cf3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:29.655070 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8f64f1a2-0dbd-4bc9-9296-8993dce86cf3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:29.655504 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8f64f1a2-0dbd-4bc9-9296-8993dce86cf3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:29.789351 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8f64f1a2-0dbd-4bc9-9296-8993dce86cf3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:29.798016 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8f64f1a2-0dbd-4bc9-9296-8993dce86cf3 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 200 len: 1498 microversion: 2.1 time: 0.156988 Sep 11 00:57:29.798596 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 101/204] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:29 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:29.928706 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-995505bb-657f-4846-a352-07e7cf89a063 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:29.931034 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-995505bb-657f-4846-a352-07e7cf89a063 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:29.932892 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:29.933574 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=6 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:29.939713 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-995505bb-657f-4846-a352-07e7cf89a063 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:29.940288 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-995505bb-657f-4846-a352-07e7cf89a063 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:29.940622 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-995505bb-657f-4846-a352-07e7cf89a063 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:29.941335 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-995505bb-657f-4846-a352-07e7cf89a063 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:29.941767 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-995505bb-657f-4846-a352-07e7cf89a063 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:29.942187 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-995505bb-657f-4846-a352-07e7cf89a063 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:29.966269 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-995505bb-657f-4846-a352-07e7cf89a063 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lazy-loading 'flavor' on Instance uuid eda4760f-be50-4efe-808f-d4ab2c0358f4 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:57:30.084243 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-995505bb-657f-4846-a352-07e7cf89a063 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "POST /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4/action" status: 200 len: 32 microversion: 2.1 time: 0.159621 Sep 11 00:57:30.084851 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 104/205] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Sep 11 00:57:29 2022] POST /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:57:30.097247 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0c5cec44-4495-4136-a49c-383f3e297b77 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:30.098301 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-0c5cec44-4495-4136-a49c-383f3e297b77 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:30.106776 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0c5cec44-4495-4136-a49c-383f3e297b77 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:30.107324 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0c5cec44-4495-4136-a49c-383f3e297b77 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:30.107895 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0c5cec44-4495-4136-a49c-383f3e297b77 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:30.108819 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0c5cec44-4495-4136-a49c-383f3e297b77 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:30.109487 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0c5cec44-4495-4136-a49c-383f3e297b77 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:30.110073 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0c5cec44-4495-4136-a49c-383f3e297b77 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:30.262949 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0c5cec44-4495-4136-a49c-383f3e297b77 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:30.273114 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0c5cec44-4495-4136-a49c-383f3e297b77 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.181851 Sep 11 00:57:30.273713 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 102/206] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:30 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:30.558014 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5e2c333f-f858-4a76-9f10-cee305ab9a03 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:30.558635 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5e2c333f-f858-4a76-9f10-cee305ab9a03 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:30.565915 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e2c333f-f858-4a76-9f10-cee305ab9a03 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:30.566404 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e2c333f-f858-4a76-9f10-cee305ab9a03 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:30.566836 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e2c333f-f858-4a76-9f10-cee305ab9a03 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:30.567719 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e2c333f-f858-4a76-9f10-cee305ab9a03 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:30.568178 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e2c333f-f858-4a76-9f10-cee305ab9a03 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:30.568597 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e2c333f-f858-4a76-9f10-cee305ab9a03 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:30.597298 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5e2c333f-f858-4a76-9f10-cee305ab9a03 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:57:30.620292 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e11017d0-7f21-4775-95d5-971d76075934 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:30.621176 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-e11017d0-7f21-4775-95d5-971d76075934 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:30.628813 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e11017d0-7f21-4775-95d5-971d76075934 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:30.629556 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e11017d0-7f21-4775-95d5-971d76075934 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:30.630003 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e11017d0-7f21-4775-95d5-971d76075934 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:30.631660 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e11017d0-7f21-4775-95d5-971d76075934 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:30.632274 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e11017d0-7f21-4775-95d5-971d76075934 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:30.632877 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e11017d0-7f21-4775-95d5-971d76075934 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:30.661016 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-e11017d0-7f21-4775-95d5-971d76075934 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/ips" status: 200 len: 152 microversion: 2.20 time: 0.045234 Sep 11 00:57:30.661726 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 103/207] 10.222.0.23 () {60 vars in 1289 bytes} [Sun Sep 11 00:57:30 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 00:57:30.720879 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5e2c333f-f858-4a76-9f10-cee305ab9a03 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "DELETE /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 204 len: 0 microversion: 2.1 time: 0.166725 Sep 11 00:57:30.722020 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 105/208] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 00:57:30 2022] DELETE /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:57:30.730282 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f3ef5a82-accf-4cdb-957f-0a72dfc08284 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:30.731123 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f3ef5a82-accf-4cdb-957f-0a72dfc08284 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:30.738490 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f3ef5a82-accf-4cdb-957f-0a72dfc08284 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:30.740691 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f3ef5a82-accf-4cdb-957f-0a72dfc08284 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:30.741320 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f3ef5a82-accf-4cdb-957f-0a72dfc08284 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:30.742020 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f3ef5a82-accf-4cdb-957f-0a72dfc08284 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:30.742650 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f3ef5a82-accf-4cdb-957f-0a72dfc08284 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:30.743054 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f3ef5a82-accf-4cdb-957f-0a72dfc08284 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:30.911163 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f3ef5a82-accf-4cdb-957f-0a72dfc08284 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:30.922964 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f3ef5a82-accf-4cdb-957f-0a72dfc08284 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 200 len: 1504 microversion: 2.1 time: 0.196521 Sep 11 00:57:30.924051 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 104/209] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:30 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:31.297089 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a843db36-b2f5-4682-92f3-806c6a31ef57 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:31.297790 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a843db36-b2f5-4682-92f3-806c6a31ef57 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:31.304588 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a843db36-b2f5-4682-92f3-806c6a31ef57 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:31.305073 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a843db36-b2f5-4682-92f3-806c6a31ef57 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:31.305510 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a843db36-b2f5-4682-92f3-806c6a31ef57 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:31.306199 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a843db36-b2f5-4682-92f3-806c6a31ef57 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:31.306648 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a843db36-b2f5-4682-92f3-806c6a31ef57 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:31.307072 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a843db36-b2f5-4682-92f3-806c6a31ef57 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:31.450695 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a843db36-b2f5-4682-92f3-806c6a31ef57 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:31.459075 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a843db36-b2f5-4682-92f3-806c6a31ef57 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.166595 Sep 11 00:57:31.459685 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 106/210] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:31 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:31.947067 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-9937041c-71b0-498b-99dc-a09fedea6071 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:31.947789 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-9937041c-71b0-498b-99dc-a09fedea6071 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:31.954330 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9937041c-71b0-498b-99dc-a09fedea6071 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:31.954815 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9937041c-71b0-498b-99dc-a09fedea6071 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:31.955267 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9937041c-71b0-498b-99dc-a09fedea6071 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:31.956015 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9937041c-71b0-498b-99dc-a09fedea6071 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:31.956510 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9937041c-71b0-498b-99dc-a09fedea6071 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:31.956931 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9937041c-71b0-498b-99dc-a09fedea6071 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:32.093428 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-9937041c-71b0-498b-99dc-a09fedea6071 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:32.101587 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-9937041c-71b0-498b-99dc-a09fedea6071 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 200 len: 1504 microversion: 2.1 time: 0.159968 Sep 11 00:57:32.102357 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 105/211] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:31 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:32.489806 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4d4ce092-71b7-4a8c-885e-0fc82e8abcf8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:32.490397 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4d4ce092-71b7-4a8c-885e-0fc82e8abcf8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:32.496893 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d4ce092-71b7-4a8c-885e-0fc82e8abcf8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:32.497368 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d4ce092-71b7-4a8c-885e-0fc82e8abcf8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:32.497769 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d4ce092-71b7-4a8c-885e-0fc82e8abcf8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:32.498485 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d4ce092-71b7-4a8c-885e-0fc82e8abcf8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:32.498903 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d4ce092-71b7-4a8c-885e-0fc82e8abcf8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:32.499349 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d4ce092-71b7-4a8c-885e-0fc82e8abcf8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:32.619846 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c0cb165f-40ea-4b75-9ce5-855c57203b05 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:32.620943 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c0cb165f-40ea-4b75-9ce5-855c57203b05 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:32.627412 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0cb165f-40ea-4b75-9ce5-855c57203b05 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:32.627899 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0cb165f-40ea-4b75-9ce5-855c57203b05 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:32.628319 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0cb165f-40ea-4b75-9ce5-855c57203b05 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:32.629191 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0cb165f-40ea-4b75-9ce5-855c57203b05 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:32.629636 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0cb165f-40ea-4b75-9ce5-855c57203b05 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:32.630520 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0cb165f-40ea-4b75-9ce5-855c57203b05 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:32.657115 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4d4ce092-71b7-4a8c-885e-0fc82e8abcf8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:32.664947 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c0cb165f-40ea-4b75-9ce5-855c57203b05 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a/ips" status: 200 len: 150 microversion: 2.1 time: 0.048135 Sep 11 00:57:32.666374 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 106/212] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Sep 11 00:57:32 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:57:32.666576 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4d4ce092-71b7-4a8c-885e-0fc82e8abcf8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.180229 Sep 11 00:57:32.667302 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 107/213] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:32 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:33.125445 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-23338ca6-782c-4f8a-9e6f-e3e8f0cb5f26 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:33.126138 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-23338ca6-782c-4f8a-9e6f-e3e8f0cb5f26 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:33.132130 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-23338ca6-782c-4f8a-9e6f-e3e8f0cb5f26 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:33.132681 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-23338ca6-782c-4f8a-9e6f-e3e8f0cb5f26 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:33.133202 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-23338ca6-782c-4f8a-9e6f-e3e8f0cb5f26 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:33.134010 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-23338ca6-782c-4f8a-9e6f-e3e8f0cb5f26 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:33.134632 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-23338ca6-782c-4f8a-9e6f-e3e8f0cb5f26 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:33.135075 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-23338ca6-782c-4f8a-9e6f-e3e8f0cb5f26 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:33.246885 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7b6c4617-9a9b-4e1c-bc73-bf15ef12e9e6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:33.247468 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7b6c4617-9a9b-4e1c-bc73-bf15ef12e9e6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:33.253862 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7b6c4617-9a9b-4e1c-bc73-bf15ef12e9e6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:33.254343 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7b6c4617-9a9b-4e1c-bc73-bf15ef12e9e6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:33.254771 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7b6c4617-9a9b-4e1c-bc73-bf15ef12e9e6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:33.255482 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7b6c4617-9a9b-4e1c-bc73-bf15ef12e9e6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:33.255930 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7b6c4617-9a9b-4e1c-bc73-bf15ef12e9e6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:33.256538 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7b6c4617-9a9b-4e1c-bc73-bf15ef12e9e6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:33.279774 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-7b6c4617-9a9b-4e1c-bc73-bf15ef12e9e6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lazy-loading 'flavor' on Instance uuid 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:57:33.404221 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-23338ca6-782c-4f8a-9e6f-e3e8f0cb5f26 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:33.417378 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-23338ca6-782c-4f8a-9e6f-e3e8f0cb5f26 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 200 len: 1504 microversion: 2.1 time: 0.295686 Sep 11 00:57:33.434310 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 107/214] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:33 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:33.520249 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7b6c4617-9a9b-4e1c-bc73-bf15ef12e9e6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "POST /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/action" status: 202 len: 0 microversion: 2.20 time: 0.277244 Sep 11 00:57:33.521995 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 108/215] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Sep 11 00:57:33 2022] POST /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:57:33.530360 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8b0ee7ff-91ea-4d64-b0ea-e2e9feefe843 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:33.531091 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-8b0ee7ff-91ea-4d64-b0ea-e2e9feefe843 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:33.539094 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8b0ee7ff-91ea-4d64-b0ea-e2e9feefe843 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:33.539991 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8b0ee7ff-91ea-4d64-b0ea-e2e9feefe843 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:33.541310 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8b0ee7ff-91ea-4d64-b0ea-e2e9feefe843 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:33.542998 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8b0ee7ff-91ea-4d64-b0ea-e2e9feefe843 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:33.544622 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8b0ee7ff-91ea-4d64-b0ea-e2e9feefe843 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:33.545139 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8b0ee7ff-91ea-4d64-b0ea-e2e9feefe843 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:33.680526 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-dbdd15a9-654f-464f-bc61-6c36b15f2cfa req-91e9c89a-ac50-4f2c-bc1b-59abb9d2b491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87320013-f620-4622-bc86-a9269a349f34", "name": "network-vif-deleted", "tag": "84753a51-1962-48c6-b812-f690c22d1ce7"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:33.695708 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-dbdd15a9-654f-464f-bc61-6c36b15f2cfa req-91e9c89a-ac50-4f2c-bc1b-59abb9d2b491 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:33.696180 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-dbdd15a9-654f-464f-bc61-6c36b15f2cfa req-91e9c89a-ac50-4f2c-bc1b-59abb9d2b491 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:33.696811 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-dbdd15a9-654f-464f-bc61-6c36b15f2cfa req-91e9c89a-ac50-4f2c-bc1b-59abb9d2b491 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:33.707595 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-dbdd15a9-654f-464f-bc61-6c36b15f2cfa req-91e9c89a-ac50-4f2c-bc1b-59abb9d2b491 service nova] Creating event network-vif-deleted:84753a51-1962-48c6-b812-f690c22d1ce7 for instance 87320013-f620-4622-bc86-a9269a349f34 on hv-cinder-maste Sep 11 00:57:33.716345 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-dbdd15a9-654f-464f-bc61-6c36b15f2cfa req-91e9c89a-ac50-4f2c-bc1b-59abb9d2b491 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040814 Sep 11 00:57:33.717085 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 109/216] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:57:33.724109 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-11afee37-4bb2-4a7d-a7c2-ef9b6353c863 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:33.725006 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-11afee37-4bb2-4a7d-a7c2-ef9b6353c863 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:33.731858 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-11afee37-4bb2-4a7d-a7c2-ef9b6353c863 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:33.732595 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-11afee37-4bb2-4a7d-a7c2-ef9b6353c863 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:33.733015 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-11afee37-4bb2-4a7d-a7c2-ef9b6353c863 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:33.733689 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-11afee37-4bb2-4a7d-a7c2-ef9b6353c863 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:33.734407 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-11afee37-4bb2-4a7d-a7c2-ef9b6353c863 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:33.734967 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-11afee37-4bb2-4a7d-a7c2-ef9b6353c863 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:33.752437 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8b0ee7ff-91ea-4d64-b0ea-e2e9feefe843 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:33.762665 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8b0ee7ff-91ea-4d64-b0ea-e2e9feefe843 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:33.764417 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8b0ee7ff-91ea-4d64-b0ea-e2e9feefe843 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:33.765761 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8b0ee7ff-91ea-4d64-b0ea-e2e9feefe843 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.239609 Sep 11 00:57:33.766491 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 108/217] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:33 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:57:33.927196 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-11afee37-4bb2-4a7d-a7c2-ef9b6353c863 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:33.935658 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-11afee37-4bb2-4a7d-a7c2-ef9b6353c863 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.217068 Sep 11 00:57:33.936461 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 110/218] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:33 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:34.073342 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5a4667c2-3a2a-4577-b8ca-57d0e0055600 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e10d8a5d-4639-4d3a-9a3e-89e1f1d4b962"}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:34.075795 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-5a4667c2-3a2a-4577-b8ca-57d0e0055600 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:34.081860 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5a4667c2-3a2a-4577-b8ca-57d0e0055600 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:34.082962 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5a4667c2-3a2a-4577-b8ca-57d0e0055600 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:34.083467 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5a4667c2-3a2a-4577-b8ca-57d0e0055600 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:34.084168 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5a4667c2-3a2a-4577-b8ca-57d0e0055600 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:34.084619 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5a4667c2-3a2a-4577-b8ca-57d0e0055600 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:34.085103 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5a4667c2-3a2a-4577-b8ca-57d0e0055600 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:34.442888 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-196ccc5e-94bc-4b3b-a003-02aa28a5a81d tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:34.444208 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-196ccc5e-94bc-4b3b-a003-02aa28a5a81d tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:34.451972 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-196ccc5e-94bc-4b3b-a003-02aa28a5a81d tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:34.461001 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-196ccc5e-94bc-4b3b-a003-02aa28a5a81d tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:34.463919 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-196ccc5e-94bc-4b3b-a003-02aa28a5a81d tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:34.467078 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-196ccc5e-94bc-4b3b-a003-02aa28a5a81d tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:34.467663 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-196ccc5e-94bc-4b3b-a003-02aa28a5a81d tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:34.468167 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-196ccc5e-94bc-4b3b-a003-02aa28a5a81d tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:34.490271 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-5a4667c2-3a2a-4577-b8ca-57d0e0055600 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "POST /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.420731 Sep 11 00:57:34.491058 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 109/219] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Sep 11 00:57:34 2022] POST /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:57:34.515355 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-196ccc5e-94bc-4b3b-a003-02aa28a5a81d tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:34.516033 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-196ccc5e-94bc-4b3b-a003-02aa28a5a81d tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:34.516562 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-196ccc5e-94bc-4b3b-a003-02aa28a5a81d tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:34.517169 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-196ccc5e-94bc-4b3b-a003-02aa28a5a81d tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lazy-loading 'fault' on Instance uuid 87320013-f620-4622-bc86-a9269a349f34 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:57:34.573622 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-196ccc5e-94bc-4b3b-a003-02aa28a5a81d tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398da9e11a194b9f9644dfad517d07b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84206f4832a4edda41c06ab2178c9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:34.582340 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-196ccc5e-94bc-4b3b-a003-02aa28a5a81d tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 200 len: 1304 microversion: 2.1 time: 0.143676 Sep 11 00:57:34.582907 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 111/220] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:34 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:34.793558 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-44dc8c27-a326-4abe-b1d0-38946389d748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:34.794624 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-44dc8c27-a326-4abe-b1d0-38946389d748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:34.802369 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-44dc8c27-a326-4abe-b1d0-38946389d748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:34.802369 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-44dc8c27-a326-4abe-b1d0-38946389d748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:34.802369 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-44dc8c27-a326-4abe-b1d0-38946389d748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:34.802840 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-44dc8c27-a326-4abe-b1d0-38946389d748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:34.803306 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-44dc8c27-a326-4abe-b1d0-38946389d748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:34.803822 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-44dc8c27-a326-4abe-b1d0-38946389d748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:34.965584 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6436324b-c210-46ec-8122-23a567a8a3d8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:34.966708 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6436324b-c210-46ec-8122-23a567a8a3d8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:34.975305 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6436324b-c210-46ec-8122-23a567a8a3d8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:34.976155 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6436324b-c210-46ec-8122-23a567a8a3d8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:34.977156 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6436324b-c210-46ec-8122-23a567a8a3d8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:34.978615 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6436324b-c210-46ec-8122-23a567a8a3d8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:34.981897 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6436324b-c210-46ec-8122-23a567a8a3d8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:34.982848 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6436324b-c210-46ec-8122-23a567a8a3d8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:34.999932 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-44dc8c27-a326-4abe-b1d0-38946389d748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:35.012822 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-44dc8c27-a326-4abe-b1d0-38946389d748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:35.015990 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-44dc8c27-a326-4abe-b1d0-38946389d748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:35.022800 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-44dc8c27-a326-4abe-b1d0-38946389d748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.229938 Sep 11 00:57:35.024021 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 110/221] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:34 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:35.280875 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6436324b-c210-46ec-8122-23a567a8a3d8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:35.283341 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:35.290118 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6436324b-c210-46ec-8122-23a567a8a3d8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.329880 Sep 11 00:57:35.290685 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 112/222] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:34 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:35.606707 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8e803acb-4b21-432b-a5fa-8e4fe2baa730 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:35.607401 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-8e803acb-4b21-432b-a5fa-8e4fe2baa730 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] [instance: 87320013-f620-4622-bc86-a9269a349f34] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:35.613996 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8e803acb-4b21-432b-a5fa-8e4fe2baa730 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:35.614468 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8e803acb-4b21-432b-a5fa-8e4fe2baa730 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:35.614921 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8e803acb-4b21-432b-a5fa-8e4fe2baa730 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:35.615620 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8e803acb-4b21-432b-a5fa-8e4fe2baa730 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:35.616598 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8e803acb-4b21-432b-a5fa-8e4fe2baa730 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:35.617028 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8e803acb-4b21-432b-a5fa-8e4fe2baa730 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:35.632200 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-8e803acb-4b21-432b-a5fa-8e4fe2baa730 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] HTTP exception thrown: Instance 87320013-f620-4622-bc86-a9269a349f34 could not be found. Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8e803acb-4b21-432b-a5fa-8e4fe2baa730 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Request method failure captured: Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 HTTP/1.1 Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTJaba2z73QklZAa8dZkfDf0vyYtK1lT38zsN_45eH2p_y2XJcwnwNWxV8CTNY_2wVI-3VTpViAiLF9Fxo5ViTxOAgEZoGBLeEsCjQnuvwmqECD_kSPRBtphwPksc95fDgDZRGPOWE71ilJycfk5HjIYh09796kzEkPDnRgoFx0OAwM Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: a84206f4832a4edda41c06ab2178c9a5 Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-VolumesActionsTest-1638871891 Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 00:57:35.633932 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 00:57:35.635369 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a84206f4832a4edda41c06ab2178c9a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a84206f4832a4edda41c06ab2178c9a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a84206f4832a4edda41c06ab2178c9a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a84206f4832a4edda41c06ab2178c9a5", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:57:35.635369 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-VolumesActionsTest-1638871891 Sep 11 00:57:35.635369 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: a84206f4832a4edda41c06ab2178c9a5 Sep 11 00:57:35.635369 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-VolumesActionsTest-1638871891 Sep 11 00:57:35.635369 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-VolumesActionsTest-1638871891-project Sep 11 00:57:35.635369 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 00:57:35.635369 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 00:57:35.635369 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 398da9e11a194b9f9644dfad517d07b4 Sep 11 00:57:35.635369 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-VolumesActionsTest-1638871891-project Sep 11 00:57:35.635369 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 00:57:35.635369 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance 87320013-f620-4622-bc86-a9269a349f34 could not be found. Sep 11 00:57:35.635369 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': '87320013-f620-4622-bc86-a9269a349f34'} Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87320013-f620-4622-bc86-a9269a349f34 could not be found. Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:57:35.636056 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87320013-f620-4622-bc86-a9269a349f34 could not be found. Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87320013-f620-4622-bc86-a9269a349f34 could not be found. Sep 11 00:57:35.637187 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:57:35.639085 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8e803acb-4b21-432b-a5fa-8e4fe2baa730 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] Returning 404 to user: Instance 87320013-f620-4622-bc86-a9269a349f34 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:57:35.639953 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8e803acb-4b21-432b-a5fa-8e4fe2baa730 tempest-VolumesActionsTest-1638871891 tempest-VolumesActionsTest-1638871891-project] 10.222.0.23 "GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34" status: 404 len: 111 microversion: 2.1 time: 0.037950 Sep 11 00:57:35.642578 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 111/223] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:35 2022] GET /compute/v2.1/servers/87320013-f620-4622-bc86-a9269a349f34 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:57:36.052595 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b645067c-7fca-4b55-af1d-507bb8a5d85f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:36.053266 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b645067c-7fca-4b55-af1d-507bb8a5d85f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:36.064229 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b645067c-7fca-4b55-af1d-507bb8a5d85f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:36.064781 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b645067c-7fca-4b55-af1d-507bb8a5d85f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:36.065299 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b645067c-7fca-4b55-af1d-507bb8a5d85f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:36.066059 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b645067c-7fca-4b55-af1d-507bb8a5d85f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:36.066570 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b645067c-7fca-4b55-af1d-507bb8a5d85f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:36.067069 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b645067c-7fca-4b55-af1d-507bb8a5d85f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:36.223823 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b645067c-7fca-4b55-af1d-507bb8a5d85f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:36.236817 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b645067c-7fca-4b55-af1d-507bb8a5d85f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:36.238373 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b645067c-7fca-4b55-af1d-507bb8a5d85f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:36.239678 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b645067c-7fca-4b55-af1d-507bb8a5d85f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.192841 Sep 11 00:57:36.240705 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 113/224] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:36 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:36.316536 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-434514bf-59f3-46e8-aa4d-52db3e969394 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:36.317162 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-434514bf-59f3-46e8-aa4d-52db3e969394 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:36.327500 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-434514bf-59f3-46e8-aa4d-52db3e969394 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:36.328348 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-434514bf-59f3-46e8-aa4d-52db3e969394 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:36.329053 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-434514bf-59f3-46e8-aa4d-52db3e969394 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:36.329772 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-434514bf-59f3-46e8-aa4d-52db3e969394 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:36.330963 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-434514bf-59f3-46e8-aa4d-52db3e969394 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:36.331747 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-434514bf-59f3-46e8-aa4d-52db3e969394 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:36.492808 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-434514bf-59f3-46e8-aa4d-52db3e969394 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:36.501652 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-434514bf-59f3-46e8-aa4d-52db3e969394 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.189026 Sep 11 00:57:36.502504 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 112/225] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:36 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:36.750202 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b8042b98-101a-4ee1-a58b-d320cdd31516 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Action: 'create', calling method: .version_select at 0x7fbb90a30040>, body: {"keypair": {"name": "tempest-keypair-1085731562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG7tfsMqALW18Fgm6pRaOckuU5aemCWh70UD/SXLZTMSYyrZeaxQ0R9CmIbLAZbkZ0TxtRfXirguAyJn1hXPIDYe2YL2IEiNshLlJaAMMbnEAInIeKjVg9Jvy1hkYECFQ=="}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:36.766540 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-b8042b98-101a-4ee1-a58b-d320cdd31516 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:57:36.770586 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-b8042b98-101a-4ee1-a58b-d320cdd31516 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for user 364cf4a7a3bf4e70973c78a5d690e998 and project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:57:36.794442 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b8042b98-101a-4ee1-a58b-d320cdd31516 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047969 Sep 11 00:57:36.795107 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 114/226] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Sep 11 00:57:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:57:37.265530 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-497993db-6377-4939-9634-55118154794c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:37.266129 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-497993db-6377-4939-9634-55118154794c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:37.272426 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-497993db-6377-4939-9634-55118154794c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:37.272902 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-497993db-6377-4939-9634-55118154794c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:37.273335 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-497993db-6377-4939-9634-55118154794c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:37.274074 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-497993db-6377-4939-9634-55118154794c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:37.274520 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-497993db-6377-4939-9634-55118154794c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:37.274936 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-497993db-6377-4939-9634-55118154794c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:37.425651 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-497993db-6377-4939-9634-55118154794c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:37.442648 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-497993db-6377-4939-9634-55118154794c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:37.444214 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-497993db-6377-4939-9634-55118154794c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:37.445938 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-497993db-6377-4939-9634-55118154794c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.184500 Sep 11 00:57:37.446592 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 113/227] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:37 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:37.532168 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-29957c73-10aa-4f71-9c0b-1cd8d15af4c0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:37.532779 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-29957c73-10aa-4f71-9c0b-1cd8d15af4c0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:37.540146 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29957c73-10aa-4f71-9c0b-1cd8d15af4c0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:37.540632 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29957c73-10aa-4f71-9c0b-1cd8d15af4c0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:37.541071 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29957c73-10aa-4f71-9c0b-1cd8d15af4c0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:37.541761 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29957c73-10aa-4f71-9c0b-1cd8d15af4c0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:37.542212 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29957c73-10aa-4f71-9c0b-1cd8d15af4c0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:37.542633 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29957c73-10aa-4f71-9c0b-1cd8d15af4c0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:37.688093 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-29957c73-10aa-4f71-9c0b-1cd8d15af4c0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:37.697704 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-29957c73-10aa-4f71-9c0b-1cd8d15af4c0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.169433 Sep 11 00:57:37.698865 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 115/228] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:37 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:38.258281 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-343771655", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "245b555a-f171-4b26-8562-bbe3df87effe"}], "security_groups": [{"name": "tempest-securitygroup--647110473"}], "key_name": "tempest-keypair-1085731562", "user_data": "}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:38.450251 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5075e45e-6ea1-46c5-badf-6bb36ac1ba1e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:38.450730 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5075e45e-6ea1-46c5-badf-6bb36ac1ba1e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:38.469668 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5075e45e-6ea1-46c5-badf-6bb36ac1ba1e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:38.470150 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5075e45e-6ea1-46c5-badf-6bb36ac1ba1e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:38.470648 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5075e45e-6ea1-46c5-badf-6bb36ac1ba1e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:38.472525 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5075e45e-6ea1-46c5-badf-6bb36ac1ba1e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:38.472525 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5075e45e-6ea1-46c5-badf-6bb36ac1ba1e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:38.472525 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5075e45e-6ea1-46c5-badf-6bb36ac1ba1e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:38.496864 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5075e45e-6ea1-46c5-badf-6bb36ac1ba1e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/ips" status: 200 len: 146 microversion: 2.1 time: 0.051940 Sep 11 00:57:38.497449 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 116/229] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Sep 11 00:57:38 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/ips => generated 146 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:57:38.503110 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5a35c6f8-1b15-4250-9b37-f97de132da2c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:38.503737 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5a35c6f8-1b15-4250-9b37-f97de132da2c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:38.511478 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a35c6f8-1b15-4250-9b37-f97de132da2c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:38.512444 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a35c6f8-1b15-4250-9b37-f97de132da2c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:38.512964 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a35c6f8-1b15-4250-9b37-f97de132da2c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:38.513689 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a35c6f8-1b15-4250-9b37-f97de132da2c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:38.514400 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a35c6f8-1b15-4250-9b37-f97de132da2c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:38.515099 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a35c6f8-1b15-4250-9b37-f97de132da2c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:38.652817 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-5a35c6f8-1b15-4250-9b37-f97de132da2c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:38.661966 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-5a35c6f8-1b15-4250-9b37-f97de132da2c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:38.663785 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-5a35c6f8-1b15-4250-9b37-f97de132da2c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:38.665061 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5a35c6f8-1b15-4250-9b37-f97de132da2c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.166700 Sep 11 00:57:38.665615 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 117/230] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:38 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:38.722439 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-82dfd8e6-2718-4835-a740-7b3a1189c7f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:38.723031 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-82dfd8e6-2718-4835-a740-7b3a1189c7f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:38.730849 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-82dfd8e6-2718-4835-a740-7b3a1189c7f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:38.731440 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-82dfd8e6-2718-4835-a740-7b3a1189c7f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:38.731902 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-82dfd8e6-2718-4835-a740-7b3a1189c7f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:38.732670 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-82dfd8e6-2718-4835-a740-7b3a1189c7f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:38.733149 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-82dfd8e6-2718-4835-a740-7b3a1189c7f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:38.733573 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-82dfd8e6-2718-4835-a740-7b3a1189c7f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:38.881584 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-82dfd8e6-2718-4835-a740-7b3a1189c7f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:38.890904 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-82dfd8e6-2718-4835-a740-7b3a1189c7f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.173189 Sep 11 00:57:38.891514 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 118/231] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:38 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:39.690867 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b2d9e116-414a-407c-b15a-42fb2a0e7c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:39.691648 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b2d9e116-414a-407c-b15a-42fb2a0e7c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:39.698522 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2d9e116-414a-407c-b15a-42fb2a0e7c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:39.699351 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2d9e116-414a-407c-b15a-42fb2a0e7c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:39.700107 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2d9e116-414a-407c-b15a-42fb2a0e7c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:39.701135 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2d9e116-414a-407c-b15a-42fb2a0e7c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:39.701725 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2d9e116-414a-407c-b15a-42fb2a0e7c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:39.702295 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2d9e116-414a-407c-b15a-42fb2a0e7c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:39.874481 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b2d9e116-414a-407c-b15a-42fb2a0e7c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:39.885180 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b2d9e116-414a-407c-b15a-42fb2a0e7c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:39.890217 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b2d9e116-414a-407c-b15a-42fb2a0e7c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:39.892607 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b2d9e116-414a-407c-b15a-42fb2a0e7c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.206315 Sep 11 00:57:39.893177 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 119/232] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:39 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:57:39.914023 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f1f15edd-39c6-45e4-9a68-36600636df94 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:39.914717 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f1f15edd-39c6-45e4-9a68-36600636df94 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:39.922120 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1f15edd-39c6-45e4-9a68-36600636df94 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:39.922595 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1f15edd-39c6-45e4-9a68-36600636df94 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:39.923019 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1f15edd-39c6-45e4-9a68-36600636df94 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:39.923738 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1f15edd-39c6-45e4-9a68-36600636df94 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:39.924178 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1f15edd-39c6-45e4-9a68-36600636df94 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:39.924770 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1f15edd-39c6-45e4-9a68-36600636df94 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:40.086871 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f1f15edd-39c6-45e4-9a68-36600636df94 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:40.096125 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f1f15edd-39c6-45e4-9a68-36600636df94 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.186043 Sep 11 00:57:40.096879 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 120/233] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:39 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:40.937975 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-248005f0-6b50-4bd4-816f-80bc7d7284b7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:40.939203 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-248005f0-6b50-4bd4-816f-80bc7d7284b7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:40.952379 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-248005f0-6b50-4bd4-816f-80bc7d7284b7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:40.952869 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-248005f0-6b50-4bd4-816f-80bc7d7284b7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:40.953652 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-248005f0-6b50-4bd4-816f-80bc7d7284b7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:40.954526 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-248005f0-6b50-4bd4-816f-80bc7d7284b7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:40.955020 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-248005f0-6b50-4bd4-816f-80bc7d7284b7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:40.955653 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-248005f0-6b50-4bd4-816f-80bc7d7284b7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:41.139362 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-248005f0-6b50-4bd4-816f-80bc7d7284b7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:41.160738 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-248005f0-6b50-4bd4-816f-80bc7d7284b7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:41.163213 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-248005f0-6b50-4bd4-816f-80bc7d7284b7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:41.164489 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-248005f0-6b50-4bd4-816f-80bc7d7284b7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.234410 Sep 11 00:57:41.180353 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 121/234] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:40 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:41.189833 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-88376611-2a6e-4af3-9e3a-f31106d67775 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:41.190465 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-88376611-2a6e-4af3-9e3a-f31106d67775 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:41.196904 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88376611-2a6e-4af3-9e3a-f31106d67775 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:41.197519 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88376611-2a6e-4af3-9e3a-f31106d67775 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:41.197962 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88376611-2a6e-4af3-9e3a-f31106d67775 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:41.198673 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88376611-2a6e-4af3-9e3a-f31106d67775 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:41.199134 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88376611-2a6e-4af3-9e3a-f31106d67775 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:41.199714 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88376611-2a6e-4af3-9e3a-f31106d67775 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:41.388808 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.network.neutron [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] validate_networks() for [('245b555a-f171-4b26-8562-bbe3df87effe', None, None, None, None, None)] {{(pid=120497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:57:41.419364 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-88376611-2a6e-4af3-9e3a-f31106d67775 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:41.436093 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-88376611-2a6e-4af3-9e3a-f31106d67775 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.254549 Sep 11 00:57:41.436678 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 122/235] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:41 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:41.893370 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Flavor limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:57:41.893988 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Image limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:57:41.894348 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Flavor pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:57:41.894752 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Image pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:57:41.895165 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:57:41.906133 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:41.906674 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:41.907220 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:41.907858 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:41.908503 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:41.909228 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:41.929933 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:57:41.934556 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for user 364cf4a7a3bf4e70973c78a5d690e998 and project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:57:41.947544 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Going to run 1 instances... {{(pid=120497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:57:41.950031 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:57:42.006466 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-5b9b0968-d97f-409a-aea3-07b0435435f7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.754766 Sep 11 00:57:42.007990 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 114/236] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 00:57:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 3756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:57:42.021069 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5e1c5073-3601-4846-a881-390d30c3719b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:42.021596 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5e1c5073-3601-4846-a881-390d30c3719b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:42.104946 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-5e1c5073-3601-4846-a881-390d30c3719b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:42.113089 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5e1c5073-3601-4846-a881-390d30c3719b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1241 microversion: 2.1 time: 0.098518 Sep 11 00:57:42.127711 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 123/237] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:42 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:42.210580 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c0d53a97-3ea5-44ac-99c5-a002d291de47 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:42.219382 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c0d53a97-3ea5-44ac-99c5-a002d291de47 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:42.228071 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0d53a97-3ea5-44ac-99c5-a002d291de47 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:42.228844 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0d53a97-3ea5-44ac-99c5-a002d291de47 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:42.229450 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0d53a97-3ea5-44ac-99c5-a002d291de47 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:42.230976 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0d53a97-3ea5-44ac-99c5-a002d291de47 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:42.231626 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0d53a97-3ea5-44ac-99c5-a002d291de47 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:42.232214 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c0d53a97-3ea5-44ac-99c5-a002d291de47 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:42.462909 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-96b44d00-8f2b-4f57-8ce2-dea456336ca7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:42.464344 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-96b44d00-8f2b-4f57-8ce2-dea456336ca7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:42.478826 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96b44d00-8f2b-4f57-8ce2-dea456336ca7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:42.479453 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96b44d00-8f2b-4f57-8ce2-dea456336ca7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:42.480341 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96b44d00-8f2b-4f57-8ce2-dea456336ca7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:42.481515 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96b44d00-8f2b-4f57-8ce2-dea456336ca7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:42.482190 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96b44d00-8f2b-4f57-8ce2-dea456336ca7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:42.482953 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96b44d00-8f2b-4f57-8ce2-dea456336ca7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:42.618003 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c0d53a97-3ea5-44ac-99c5-a002d291de47 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:42.643028 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c0d53a97-3ea5-44ac-99c5-a002d291de47 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:42.644770 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c0d53a97-3ea5-44ac-99c5-a002d291de47 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:42.674807 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c0d53a97-3ea5-44ac-99c5-a002d291de47 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.483523 Sep 11 00:57:42.675451 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 115/238] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:42 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:57:42.861184 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-96b44d00-8f2b-4f57-8ce2-dea456336ca7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:42.874486 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-96b44d00-8f2b-4f57-8ce2-dea456336ca7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.415963 Sep 11 00:57:42.875433 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 124/239] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:42 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:43.156029 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d8d44b41-0b8f-414a-842b-bb1f55019eb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:43.156296 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d8d44b41-0b8f-414a-842b-bb1f55019eb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:43.170951 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d8d44b41-0b8f-414a-842b-bb1f55019eb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:43.171872 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d8d44b41-0b8f-414a-842b-bb1f55019eb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:43.172311 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d8d44b41-0b8f-414a-842b-bb1f55019eb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:43.175272 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d8d44b41-0b8f-414a-842b-bb1f55019eb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:43.175824 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d8d44b41-0b8f-414a-842b-bb1f55019eb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:43.176329 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d8d44b41-0b8f-414a-842b-bb1f55019eb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:43.263953 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d8d44b41-0b8f-414a-842b-bb1f55019eb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:43.273944 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d8d44b41-0b8f-414a-842b-bb1f55019eb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1237 microversion: 2.1 time: 0.120690 Sep 11 00:57:43.277222 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 116/240] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:43 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1237 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:43.704254 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1ccf1897-fbee-4f02-b732-b0910bcb863d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:43.705072 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1ccf1897-fbee-4f02-b732-b0910bcb863d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:43.716080 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ccf1897-fbee-4f02-b732-b0910bcb863d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:43.718885 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ccf1897-fbee-4f02-b732-b0910bcb863d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:43.721721 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ccf1897-fbee-4f02-b732-b0910bcb863d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:43.722600 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ccf1897-fbee-4f02-b732-b0910bcb863d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:43.723157 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ccf1897-fbee-4f02-b732-b0910bcb863d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:43.724912 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ccf1897-fbee-4f02-b732-b0910bcb863d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:43.879315 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1ccf1897-fbee-4f02-b732-b0910bcb863d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:43.888794 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1ccf1897-fbee-4f02-b732-b0910bcb863d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:43.890225 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1ccf1897-fbee-4f02-b732-b0910bcb863d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:43.891439 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1ccf1897-fbee-4f02-b732-b0910bcb863d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.192424 Sep 11 00:57:43.892061 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 125/241] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:43 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:43.901528 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-72b8225e-a1cc-4f38-8f31-df7bc511625d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:43.902620 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-72b8225e-a1cc-4f38-8f31-df7bc511625d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:43.915812 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-72b8225e-a1cc-4f38-8f31-df7bc511625d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:43.916756 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-72b8225e-a1cc-4f38-8f31-df7bc511625d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:43.917421 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-72b8225e-a1cc-4f38-8f31-df7bc511625d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:43.919557 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-72b8225e-a1cc-4f38-8f31-df7bc511625d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:43.921120 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-72b8225e-a1cc-4f38-8f31-df7bc511625d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:43.922218 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-72b8225e-a1cc-4f38-8f31-df7bc511625d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:43.931070 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:44.070513 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-72b8225e-a1cc-4f38-8f31-df7bc511625d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:44.078753 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-72b8225e-a1cc-4f38-8f31-df7bc511625d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.181191 Sep 11 00:57:44.079566 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 117/242] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:43 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:44.321053 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3aabc49a-a094-409e-8131-0232b5454076 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:44.321980 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3aabc49a-a094-409e-8131-0232b5454076 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:44.336654 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3aabc49a-a094-409e-8131-0232b5454076 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:44.343457 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3aabc49a-a094-409e-8131-0232b5454076 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:44.344067 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3aabc49a-a094-409e-8131-0232b5454076 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:44.346193 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3aabc49a-a094-409e-8131-0232b5454076 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:44.346812 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3aabc49a-a094-409e-8131-0232b5454076 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:44.347424 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3aabc49a-a094-409e-8131-0232b5454076 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:44.505698 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a0b36e20-7e4c-4bb5-a26a-3c359173dc37 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "240a1b49-0068-4155-a2e0-feebe70b17fb"}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:44.509030 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a0b36e20-7e4c-4bb5-a26a-3c359173dc37 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:44.522469 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a0b36e20-7e4c-4bb5-a26a-3c359173dc37 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:44.524646 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a0b36e20-7e4c-4bb5-a26a-3c359173dc37 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:44.525230 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a0b36e20-7e4c-4bb5-a26a-3c359173dc37 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:44.526760 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a0b36e20-7e4c-4bb5-a26a-3c359173dc37 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:44.527496 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a0b36e20-7e4c-4bb5-a26a-3c359173dc37 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:44.529053 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a0b36e20-7e4c-4bb5-a26a-3c359173dc37 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:44.633388 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3aabc49a-a094-409e-8131-0232b5454076 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:44.654364 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3aabc49a-a094-409e-8131-0232b5454076 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1301 microversion: 2.1 time: 0.337019 Sep 11 00:57:44.655740 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 126/243] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:44 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1301 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:44.922570 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7f2e8daf-4b8a-460f-b368-89ff9f840f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:44.923635 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7f2e8daf-4b8a-460f-b368-89ff9f840f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:44.940654 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7f2e8daf-4b8a-460f-b368-89ff9f840f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:44.941202 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7f2e8daf-4b8a-460f-b368-89ff9f840f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:44.941664 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7f2e8daf-4b8a-460f-b368-89ff9f840f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:44.942373 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7f2e8daf-4b8a-460f-b368-89ff9f840f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:44.942826 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7f2e8daf-4b8a-460f-b368-89ff9f840f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:44.943270 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7f2e8daf-4b8a-460f-b368-89ff9f840f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:45.093473 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a0b36e20-7e4c-4bb5-a26a-3c359173dc37 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "POST /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.593190 Sep 11 00:57:45.094391 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 118/244] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Sep 11 00:57:44 2022] POST /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/os-volume_attachments => generated 194 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:57:45.120153 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-7c17b3ab-8cca-4bbd-ae1c-c68c53e2c7fd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:45.122574 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-7c17b3ab-8cca-4bbd-ae1c-c68c53e2c7fd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:45.135753 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7c17b3ab-8cca-4bbd-ae1c-c68c53e2c7fd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:45.137722 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7c17b3ab-8cca-4bbd-ae1c-c68c53e2c7fd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:45.138675 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7c17b3ab-8cca-4bbd-ae1c-c68c53e2c7fd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:45.148248 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7c17b3ab-8cca-4bbd-ae1c-c68c53e2c7fd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:45.149057 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7c17b3ab-8cca-4bbd-ae1c-c68c53e2c7fd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:45.149828 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7c17b3ab-8cca-4bbd-ae1c-c68c53e2c7fd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:45.595652 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-7c17b3ab-8cca-4bbd-ae1c-c68c53e2c7fd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:45.606375 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-7c17b3ab-8cca-4bbd-ae1c-c68c53e2c7fd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.505141 Sep 11 00:57:45.622445 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 119/245] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:45 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:45.648415 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-7f2e8daf-4b8a-460f-b368-89ff9f840f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:45.665901 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-7f2e8daf-4b8a-460f-b368-89ff9f840f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:45.668433 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-7f2e8daf-4b8a-460f-b368-89ff9f840f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:45.670137 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7f2e8daf-4b8a-460f-b368-89ff9f840f4b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.752914 Sep 11 00:57:45.691203 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 127/246] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:44 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:45.691464 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-4cc0ae03-fc7f-4135-94e4-c66e0617d869 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:45.691464 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-4cc0ae03-fc7f-4135-94e4-c66e0617d869 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:45.693048 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4cc0ae03-fc7f-4135-94e4-c66e0617d869 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:45.693590 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4cc0ae03-fc7f-4135-94e4-c66e0617d869 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:45.694071 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4cc0ae03-fc7f-4135-94e4-c66e0617d869 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:45.695069 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4cc0ae03-fc7f-4135-94e4-c66e0617d869 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:45.695839 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4cc0ae03-fc7f-4135-94e4-c66e0617d869 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:45.696502 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4cc0ae03-fc7f-4135-94e4-c66e0617d869 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:45.872033 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-4cc0ae03-fc7f-4135-94e4-c66e0617d869 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:45.891801 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-4cc0ae03-fc7f-4135-94e4-c66e0617d869 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1299 microversion: 2.1 time: 0.212046 Sep 11 00:57:45.895540 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 120/247] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:45 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1299 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:46.634501 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d5905755-5f62-45ac-9859-ab9501bcd701 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:46.635924 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d5905755-5f62-45ac-9859-ab9501bcd701 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:46.646903 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d5905755-5f62-45ac-9859-ab9501bcd701 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:46.649934 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d5905755-5f62-45ac-9859-ab9501bcd701 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:46.653010 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d5905755-5f62-45ac-9859-ab9501bcd701 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:46.655893 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d5905755-5f62-45ac-9859-ab9501bcd701 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:46.664949 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d5905755-5f62-45ac-9859-ab9501bcd701 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:46.668803 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d5905755-5f62-45ac-9859-ab9501bcd701 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:46.707036 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-96a81c3c-2ad2-4cf3-ac8d-2b5f777852fc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:46.708544 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-96a81c3c-2ad2-4cf3-ac8d-2b5f777852fc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:46.721347 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-96a81c3c-2ad2-4cf3-ac8d-2b5f777852fc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:46.722081 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-96a81c3c-2ad2-4cf3-ac8d-2b5f777852fc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:46.725143 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-96a81c3c-2ad2-4cf3-ac8d-2b5f777852fc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:46.726143 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-96a81c3c-2ad2-4cf3-ac8d-2b5f777852fc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:46.726886 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-96a81c3c-2ad2-4cf3-ac8d-2b5f777852fc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:46.727845 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-96a81c3c-2ad2-4cf3-ac8d-2b5f777852fc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:47.084445 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-96a81c3c-2ad2-4cf3-ac8d-2b5f777852fc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:47.098802 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-96a81c3c-2ad2-4cf3-ac8d-2b5f777852fc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:47.101858 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-96a81c3c-2ad2-4cf3-ac8d-2b5f777852fc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:47.108827 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-96a81c3c-2ad2-4cf3-ac8d-2b5f777852fc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.406256 Sep 11 00:57:47.110271 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 121/248] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:46 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:47.116439 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-876e52c8-2678-4d81-8770-b80ba8c6fb3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:47.117276 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-876e52c8-2678-4d81-8770-b80ba8c6fb3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:47.125530 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-876e52c8-2678-4d81-8770-b80ba8c6fb3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:47.126236 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-876e52c8-2678-4d81-8770-b80ba8c6fb3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:47.126986 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-876e52c8-2678-4d81-8770-b80ba8c6fb3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:47.127925 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-876e52c8-2678-4d81-8770-b80ba8c6fb3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:47.128513 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-876e52c8-2678-4d81-8770-b80ba8c6fb3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:47.129706 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-876e52c8-2678-4d81-8770-b80ba8c6fb3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:47.190158 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-d5905755-5f62-45ac-9859-ab9501bcd701 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:47.201299 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d5905755-5f62-45ac-9859-ab9501bcd701 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.574828 Sep 11 00:57:47.203858 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 128/249] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:46 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:47.490852 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-876e52c8-2678-4d81-8770-b80ba8c6fb3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:47.520066 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-876e52c8-2678-4d81-8770-b80ba8c6fb3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1366 microversion: 2.1 time: 0.408197 Sep 11 00:57:47.521252 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 122/250] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:47 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:47.530995 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1e60ed1c-58cc-4f01-be9e-077427efeb78 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:47.552377 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e60ed1c-58cc-4f01-be9e-077427efeb78 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:47.552788 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e60ed1c-58cc-4f01-be9e-077427efeb78 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:47.553368 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e60ed1c-58cc-4f01-be9e-077427efeb78 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:47.681778 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1e60ed1c-58cc-4f01-be9e-077427efeb78 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Going to try to stop instance {{(pid=120496) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 11 00:57:47.750547 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1e60ed1c-58cc-4f01-be9e-077427efeb78 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "POST /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/action" status: 202 len: 0 microversion: 2.1 time: 0.230413 Sep 11 00:57:47.751600 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 129/251] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Sep 11 00:57:47 2022] POST /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:57:47.770533 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-45c7791a-7866-4279-ad80-182ee30daa0e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:47.771864 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-45c7791a-7866-4279-ad80-182ee30daa0e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:47.783549 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-45c7791a-7866-4279-ad80-182ee30daa0e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:47.784174 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-45c7791a-7866-4279-ad80-182ee30daa0e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:47.797798 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-45c7791a-7866-4279-ad80-182ee30daa0e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:47.798849 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-45c7791a-7866-4279-ad80-182ee30daa0e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:47.799661 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-45c7791a-7866-4279-ad80-182ee30daa0e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:47.801051 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-45c7791a-7866-4279-ad80-182ee30daa0e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:48.080685 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-45c7791a-7866-4279-ad80-182ee30daa0e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:48.103904 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-45c7791a-7866-4279-ad80-182ee30daa0e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1722 microversion: 2.1 time: 0.347093 Sep 11 00:57:48.108045 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 123/252] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:47 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1722 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:48.135767 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-cdbf517b-b434-423d-926d-927b80c22122 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:48.136668 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-cdbf517b-b434-423d-926d-927b80c22122 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:48.143480 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-d7cc01ab-8fad-406b-9d6f-290c08ff890b req-87292128-8d2c-44fd-a941-9156ec2e2288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a384877e-aaf3-4e9c-b99c-f98084c2ebab", "tag": "d347821a-deb0-4b3c-b6d4-e1f4f98e348f"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:48.144258 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cdbf517b-b434-423d-926d-927b80c22122 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:48.144750 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cdbf517b-b434-423d-926d-927b80c22122 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:48.145390 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cdbf517b-b434-423d-926d-927b80c22122 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:48.146864 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cdbf517b-b434-423d-926d-927b80c22122 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:48.147831 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cdbf517b-b434-423d-926d-927b80c22122 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:48.148402 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cdbf517b-b434-423d-926d-927b80c22122 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:48.165760 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-d7cc01ab-8fad-406b-9d6f-290c08ff890b req-87292128-8d2c-44fd-a941-9156ec2e2288 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:48.166231 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-d7cc01ab-8fad-406b-9d6f-290c08ff890b req-87292128-8d2c-44fd-a941-9156ec2e2288 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:48.166814 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-d7cc01ab-8fad-406b-9d6f-290c08ff890b req-87292128-8d2c-44fd-a941-9156ec2e2288 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:48.195024 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-d7cc01ab-8fad-406b-9d6f-290c08ff890b req-87292128-8d2c-44fd-a941-9156ec2e2288 service nova] Creating event network-changed:d347821a-deb0-4b3c-b6d4-e1f4f98e348f for instance a384877e-aaf3-4e9c-b99c-f98084c2ebab on hv-cinder-maste Sep 11 00:57:48.201452 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-d7cc01ab-8fad-406b-9d6f-290c08ff890b req-87292128-8d2c-44fd-a941-9156ec2e2288 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061206 Sep 11 00:57:48.202541 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 124/253] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:57:48.244372 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6b41f07b-0cca-49c5-9ebe-9cce730c1466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:48.265703 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6b41f07b-0cca-49c5-9ebe-9cce730c1466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:48.275460 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6b41f07b-0cca-49c5-9ebe-9cce730c1466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:48.275731 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6b41f07b-0cca-49c5-9ebe-9cce730c1466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:48.277073 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6b41f07b-0cca-49c5-9ebe-9cce730c1466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:48.278718 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6b41f07b-0cca-49c5-9ebe-9cce730c1466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:48.280872 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6b41f07b-0cca-49c5-9ebe-9cce730c1466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:48.282100 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6b41f07b-0cca-49c5-9ebe-9cce730c1466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:48.515810 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-cdbf517b-b434-423d-926d-927b80c22122 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:48.518427 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:48.528971 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-cdbf517b-b434-423d-926d-927b80c22122 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:48.531898 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-cdbf517b-b434-423d-926d-927b80c22122 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:48.533106 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-cdbf517b-b434-423d-926d-927b80c22122 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.402831 Sep 11 00:57:48.533885 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 130/254] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:48 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:48.547012 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5d5d2d4b-5b40-4dcd-9863-7aa6954ba259 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:48.548510 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5d5d2d4b-5b40-4dcd-9863-7aa6954ba259 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:48.556262 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5d5d2d4b-5b40-4dcd-9863-7aa6954ba259 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:48.557139 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5d5d2d4b-5b40-4dcd-9863-7aa6954ba259 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:48.557761 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5d5d2d4b-5b40-4dcd-9863-7aa6954ba259 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:48.558687 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5d5d2d4b-5b40-4dcd-9863-7aa6954ba259 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:48.559800 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5d5d2d4b-5b40-4dcd-9863-7aa6954ba259 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:48.560241 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5d5d2d4b-5b40-4dcd-9863-7aa6954ba259 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:48.593963 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6b41f07b-0cca-49c5-9ebe-9cce730c1466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:48.606797 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6b41f07b-0cca-49c5-9ebe-9cce730c1466 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.372188 Sep 11 00:57:48.608243 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 125/255] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:48 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:48.727128 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-5d5d2d4b-5b40-4dcd-9863-7aa6954ba259 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:48.737385 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5d5d2d4b-5b40-4dcd-9863-7aa6954ba259 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1366 microversion: 2.1 time: 0.197234 Sep 11 00:57:48.738413 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 131/256] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:48 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:49.131891 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0d431dec-b0f4-4768-a5d4-2d4147a94dad tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:49.132518 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-0d431dec-b0f4-4768-a5d4-2d4147a94dad tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:49.140256 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0d431dec-b0f4-4768-a5d4-2d4147a94dad tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:49.140957 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0d431dec-b0f4-4768-a5d4-2d4147a94dad tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:49.141389 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0d431dec-b0f4-4768-a5d4-2d4147a94dad tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:49.142075 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0d431dec-b0f4-4768-a5d4-2d4147a94dad tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:49.142672 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0d431dec-b0f4-4768-a5d4-2d4147a94dad tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:49.143262 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0d431dec-b0f4-4768-a5d4-2d4147a94dad tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:49.302686 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0d431dec-b0f4-4768-a5d4-2d4147a94dad tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:49.311618 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0d431dec-b0f4-4768-a5d4-2d4147a94dad tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1722 microversion: 2.1 time: 0.184073 Sep 11 00:57:49.312912 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 126/257] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:49 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:49.562597 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-df982227-a98d-413d-acaf-f66f277f77d6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:49.563123 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-df982227-a98d-413d-acaf-f66f277f77d6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:49.566468 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:49.569908 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df982227-a98d-413d-acaf-f66f277f77d6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:49.570398 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df982227-a98d-413d-acaf-f66f277f77d6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:49.570827 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df982227-a98d-413d-acaf-f66f277f77d6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:49.571931 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df982227-a98d-413d-acaf-f66f277f77d6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:49.572463 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df982227-a98d-413d-acaf-f66f277f77d6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:49.572924 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df982227-a98d-413d-acaf-f66f277f77d6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:49.630438 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6e9def03-5a36-4ecb-9dbf-779c84a6c3bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:49.631399 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6e9def03-5a36-4ecb-9dbf-779c84a6c3bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:49.645753 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6e9def03-5a36-4ecb-9dbf-779c84a6c3bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:49.646335 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6e9def03-5a36-4ecb-9dbf-779c84a6c3bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:49.646841 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6e9def03-5a36-4ecb-9dbf-779c84a6c3bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:49.647577 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6e9def03-5a36-4ecb-9dbf-779c84a6c3bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:49.648188 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6e9def03-5a36-4ecb-9dbf-779c84a6c3bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:49.648608 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6e9def03-5a36-4ecb-9dbf-779c84a6c3bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:49.757215 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-df982227-a98d-413d-acaf-f66f277f77d6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:49.778913 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-df982227-a98d-413d-acaf-f66f277f77d6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:49.804101 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-df982227-a98d-413d-acaf-f66f277f77d6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:49.806883 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-df982227-a98d-413d-acaf-f66f277f77d6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.248515 Sep 11 00:57:49.808628 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 132/258] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:49 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:49.826456 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f883f99e-efa6-42cc-b9fe-d53be2778bc2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:49.827994 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f883f99e-efa6-42cc-b9fe-d53be2778bc2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:49.838993 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f883f99e-efa6-42cc-b9fe-d53be2778bc2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:49.840364 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f883f99e-efa6-42cc-b9fe-d53be2778bc2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:49.841537 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f883f99e-efa6-42cc-b9fe-d53be2778bc2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:49.843023 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f883f99e-efa6-42cc-b9fe-d53be2778bc2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:49.843963 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f883f99e-efa6-42cc-b9fe-d53be2778bc2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:49.844982 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f883f99e-efa6-42cc-b9fe-d53be2778bc2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:49.903507 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6e9def03-5a36-4ecb-9dbf-779c84a6c3bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:49.931327 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6e9def03-5a36-4ecb-9dbf-779c84a6c3bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.304523 Sep 11 00:57:49.933297 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 127/259] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:49 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:50.162434 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f883f99e-efa6-42cc-b9fe-d53be2778bc2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:50.171064 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f883f99e-efa6-42cc-b9fe-d53be2778bc2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1366 microversion: 2.1 time: 0.360749 Sep 11 00:57:50.171666 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 133/260] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:49 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:50.336633 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-878c966f-4c85-44c4-96c6-7d261376968a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:50.337314 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-878c966f-4c85-44c4-96c6-7d261376968a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:50.343784 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-878c966f-4c85-44c4-96c6-7d261376968a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:50.344435 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-878c966f-4c85-44c4-96c6-7d261376968a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:50.344942 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-878c966f-4c85-44c4-96c6-7d261376968a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:50.345648 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-878c966f-4c85-44c4-96c6-7d261376968a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:50.346377 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-878c966f-4c85-44c4-96c6-7d261376968a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:50.346801 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-878c966f-4c85-44c4-96c6-7d261376968a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:50.557114 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-878c966f-4c85-44c4-96c6-7d261376968a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:50.570836 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-878c966f-4c85-44c4-96c6-7d261376968a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1722 microversion: 2.1 time: 0.238832 Sep 11 00:57:50.571498 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 128/261] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:50 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:50.835495 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-65fd12e8-32a4-44ad-95c6-254a731499c8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:50.836114 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-65fd12e8-32a4-44ad-95c6-254a731499c8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:50.842885 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-65fd12e8-32a4-44ad-95c6-254a731499c8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:50.843526 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-65fd12e8-32a4-44ad-95c6-254a731499c8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:50.843962 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-65fd12e8-32a4-44ad-95c6-254a731499c8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:50.844657 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-65fd12e8-32a4-44ad-95c6-254a731499c8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:50.845139 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-65fd12e8-32a4-44ad-95c6-254a731499c8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:50.845565 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-65fd12e8-32a4-44ad-95c6-254a731499c8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:50.965102 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-891e0dd7-293d-4cc0-99de-a068b0b322a2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:50.967044 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-891e0dd7-293d-4cc0-99de-a068b0b322a2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:50.974824 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-891e0dd7-293d-4cc0-99de-a068b0b322a2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:50.976227 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-891e0dd7-293d-4cc0-99de-a068b0b322a2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:50.976822 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-891e0dd7-293d-4cc0-99de-a068b0b322a2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:50.977929 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-891e0dd7-293d-4cc0-99de-a068b0b322a2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:50.979130 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-891e0dd7-293d-4cc0-99de-a068b0b322a2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:50.979798 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-891e0dd7-293d-4cc0-99de-a068b0b322a2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:50.988513 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-65fd12e8-32a4-44ad-95c6-254a731499c8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:51.001780 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-65fd12e8-32a4-44ad-95c6-254a731499c8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:51.004370 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-65fd12e8-32a4-44ad-95c6-254a731499c8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:51.005767 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-65fd12e8-32a4-44ad-95c6-254a731499c8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1745 microversion: 2.20 time: 0.174253 Sep 11 00:57:51.007320 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 134/262] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:50 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:51.140447 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-891e0dd7-293d-4cc0-99de-a068b0b322a2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:51.150537 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-891e0dd7-293d-4cc0-99de-a068b0b322a2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.190898 Sep 11 00:57:51.151225 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 129/263] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:50 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:51.195565 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-90bc252a-4383-491a-ad22-1c615ee5d281 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:51.196169 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-90bc252a-4383-491a-ad22-1c615ee5d281 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:51.202317 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-90bc252a-4383-491a-ad22-1c615ee5d281 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:51.202795 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-90bc252a-4383-491a-ad22-1c615ee5d281 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:51.203257 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-90bc252a-4383-491a-ad22-1c615ee5d281 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:51.203948 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-90bc252a-4383-491a-ad22-1c615ee5d281 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:51.204396 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-90bc252a-4383-491a-ad22-1c615ee5d281 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:51.204862 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-90bc252a-4383-491a-ad22-1c615ee5d281 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:51.347237 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-90bc252a-4383-491a-ad22-1c615ee5d281 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:51.354979 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-90bc252a-4383-491a-ad22-1c615ee5d281 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1366 microversion: 2.1 time: 0.163381 Sep 11 00:57:51.355584 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 135/264] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:51 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:51.594519 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-905721b0-3817-4f91-9128-5d1f3c24c1f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:51.595806 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-905721b0-3817-4f91-9128-5d1f3c24c1f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:51.603995 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-905721b0-3817-4f91-9128-5d1f3c24c1f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:51.604559 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-905721b0-3817-4f91-9128-5d1f3c24c1f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:51.604997 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-905721b0-3817-4f91-9128-5d1f3c24c1f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:51.605742 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-905721b0-3817-4f91-9128-5d1f3c24c1f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:51.606263 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-905721b0-3817-4f91-9128-5d1f3c24c1f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:51.606687 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-905721b0-3817-4f91-9128-5d1f3c24c1f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:51.920708 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=2 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:51.924872 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-905721b0-3817-4f91-9128-5d1f3c24c1f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:51.942667 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-905721b0-3817-4f91-9128-5d1f3c24c1f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1722 microversion: 2.1 time: 0.351876 Sep 11 00:57:51.947236 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 130/265] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:51 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:52.036615 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-66de081d-d3ed-4d95-9310-46c1bae9e6ec tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:52.038239 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-66de081d-d3ed-4d95-9310-46c1bae9e6ec tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:52.046288 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66de081d-d3ed-4d95-9310-46c1bae9e6ec tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:52.047865 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66de081d-d3ed-4d95-9310-46c1bae9e6ec tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:52.048876 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66de081d-d3ed-4d95-9310-46c1bae9e6ec tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:52.050132 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66de081d-d3ed-4d95-9310-46c1bae9e6ec tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:52.050831 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66de081d-d3ed-4d95-9310-46c1bae9e6ec tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:52.051614 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66de081d-d3ed-4d95-9310-46c1bae9e6ec tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:52.110370 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=6 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:52.176172 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d9a23703-6e04-4c4e-b136-c41884e4d61c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:52.177098 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d9a23703-6e04-4c4e-b136-c41884e4d61c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:52.193995 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=6 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:52.198294 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d9a23703-6e04-4c4e-b136-c41884e4d61c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:52.199286 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d9a23703-6e04-4c4e-b136-c41884e4d61c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:52.200143 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d9a23703-6e04-4c4e-b136-c41884e4d61c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:52.201439 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d9a23703-6e04-4c4e-b136-c41884e4d61c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:52.202315 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d9a23703-6e04-4c4e-b136-c41884e4d61c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:52.203162 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d9a23703-6e04-4c4e-b136-c41884e4d61c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:52.358923 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-66de081d-d3ed-4d95-9310-46c1bae9e6ec tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:52.369624 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-66de081d-d3ed-4d95-9310-46c1bae9e6ec tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:52.371121 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-66de081d-d3ed-4d95-9310-46c1bae9e6ec tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:52.372929 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-66de081d-d3ed-4d95-9310-46c1bae9e6ec tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1745 microversion: 2.20 time: 0.340307 Sep 11 00:57:52.374039 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 136/266] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:52 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1745 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:52.391919 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-02dcfa0d-6d4c-4f1f-9faa-cbe0d63b1953 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:52.392747 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-02dcfa0d-6d4c-4f1f-9faa-cbe0d63b1953 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:52.401373 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-02dcfa0d-6d4c-4f1f-9faa-cbe0d63b1953 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:52.402250 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-02dcfa0d-6d4c-4f1f-9faa-cbe0d63b1953 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:52.402911 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-02dcfa0d-6d4c-4f1f-9faa-cbe0d63b1953 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:52.404768 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-02dcfa0d-6d4c-4f1f-9faa-cbe0d63b1953 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:52.405761 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-02dcfa0d-6d4c-4f1f-9faa-cbe0d63b1953 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:52.406820 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-02dcfa0d-6d4c-4f1f-9faa-cbe0d63b1953 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:52.571717 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d9a23703-6e04-4c4e-b136-c41884e4d61c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:52.584758 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d9a23703-6e04-4c4e-b136-c41884e4d61c tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.414623 Sep 11 00:57:52.586520 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 131/267] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:52 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:52.695840 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-5c1b9c75-39c9-4556-a314-e96a1e35fa21 req-393545bc-2ebe-4639-972b-80fd05881c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185afbdf-74f7-4a54-8ba8-58e7b6fd2e73", "name": "network-vif-plugged", "status": "completed", "tag": "903eede7-b91a-4899-9cea-f0ba8d7eea74"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:52.714126 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-02dcfa0d-6d4c-4f1f-9faa-cbe0d63b1953 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:52.730333 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-02dcfa0d-6d4c-4f1f-9faa-cbe0d63b1953 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1366 microversion: 2.1 time: 0.354580 Sep 11 00:57:52.732756 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 137/268] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:52 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:52.735847 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-5c1b9c75-39c9-4556-a314-e96a1e35fa21 req-393545bc-2ebe-4639-972b-80fd05881c9b service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:52.736732 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-5c1b9c75-39c9-4556-a314-e96a1e35fa21 req-393545bc-2ebe-4639-972b-80fd05881c9b service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:52.737869 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-5c1b9c75-39c9-4556-a314-e96a1e35fa21 req-393545bc-2ebe-4639-972b-80fd05881c9b service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:52.753877 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-5c1b9c75-39c9-4556-a314-e96a1e35fa21 req-393545bc-2ebe-4639-972b-80fd05881c9b service nova] Creating event network-vif-plugged:903eede7-b91a-4899-9cea-f0ba8d7eea74 for instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 on hv-cinder-maste Sep 11 00:57:52.763149 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-5c1b9c75-39c9-4556-a314-e96a1e35fa21 req-393545bc-2ebe-4639-972b-80fd05881c9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071596 Sep 11 00:57:52.764104 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 132/269] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:57:52.966748 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ffebd9a8-c404-402c-848f-4b6d7392ad76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:52.967428 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ffebd9a8-c404-402c-848f-4b6d7392ad76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:52.973666 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ffebd9a8-c404-402c-848f-4b6d7392ad76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:52.974157 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ffebd9a8-c404-402c-848f-4b6d7392ad76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:52.974597 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ffebd9a8-c404-402c-848f-4b6d7392ad76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:52.975317 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ffebd9a8-c404-402c-848f-4b6d7392ad76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:52.975820 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ffebd9a8-c404-402c-848f-4b6d7392ad76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:52.976244 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ffebd9a8-c404-402c-848f-4b6d7392ad76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:53.191294 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-ffebd9a8-c404-402c-848f-4b6d7392ad76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:53.206557 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ffebd9a8-c404-402c-848f-4b6d7392ad76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1722 microversion: 2.1 time: 0.244370 Sep 11 00:57:53.207530 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 138/270] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:52 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:53.398995 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-14b7b6fb-b49f-4175-8571-820f7c1f398b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:53.399690 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-14b7b6fb-b49f-4175-8571-820f7c1f398b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:53.405271 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:53.407455 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-14b7b6fb-b49f-4175-8571-820f7c1f398b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:53.407944 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-14b7b6fb-b49f-4175-8571-820f7c1f398b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:53.408381 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-14b7b6fb-b49f-4175-8571-820f7c1f398b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:53.409080 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-14b7b6fb-b49f-4175-8571-820f7c1f398b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:53.413004 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-14b7b6fb-b49f-4175-8571-820f7c1f398b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:53.414331 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-14b7b6fb-b49f-4175-8571-820f7c1f398b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:53.612394 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-444a2690-38c3-4a3d-a3ab-88e87694d7c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:53.613005 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-444a2690-38c3-4a3d-a3ab-88e87694d7c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:53.623900 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-444a2690-38c3-4a3d-a3ab-88e87694d7c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:53.624670 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-444a2690-38c3-4a3d-a3ab-88e87694d7c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:53.625518 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-444a2690-38c3-4a3d-a3ab-88e87694d7c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:53.626470 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-444a2690-38c3-4a3d-a3ab-88e87694d7c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:53.627146 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-444a2690-38c3-4a3d-a3ab-88e87694d7c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:53.627831 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-444a2690-38c3-4a3d-a3ab-88e87694d7c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:54.032377 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-444a2690-38c3-4a3d-a3ab-88e87694d7c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:54.043579 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-14b7b6fb-b49f-4175-8571-820f7c1f398b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:54.043579 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:54.063659 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-14b7b6fb-b49f-4175-8571-820f7c1f398b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:54.065663 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-14b7b6fb-b49f-4175-8571-820f7c1f398b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:54.068654 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-14b7b6fb-b49f-4175-8571-820f7c1f398b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1745 microversion: 2.20 time: 0.673331 Sep 11 00:57:54.069690 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 133/271] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:53 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1745 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:54.080366 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a4543edc-8096-4dce-990b-8311ccc4217d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:54.080366 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a4543edc-8096-4dce-990b-8311ccc4217d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:54.086372 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a4543edc-8096-4dce-990b-8311ccc4217d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:54.095342 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-444a2690-38c3-4a3d-a3ab-88e87694d7c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1500 microversion: 2.1 time: 0.480645 Sep 11 00:57:54.098481 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a4543edc-8096-4dce-990b-8311ccc4217d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:54.098481 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a4543edc-8096-4dce-990b-8311ccc4217d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:54.098690 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 139/272] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:53 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1500 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:54.098780 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a4543edc-8096-4dce-990b-8311ccc4217d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:54.098780 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a4543edc-8096-4dce-990b-8311ccc4217d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:54.098780 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a4543edc-8096-4dce-990b-8311ccc4217d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:54.119872 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c07e1a9a-64b6-434d-b239-54f1e7d574ce tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "adcfb648-f28d-4d34-8642-c7fd91bd7492"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:54.126061 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c07e1a9a-64b6-434d-b239-54f1e7d574ce tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:54.132553 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c07e1a9a-64b6-434d-b239-54f1e7d574ce tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:54.135396 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c07e1a9a-64b6-434d-b239-54f1e7d574ce tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:54.136714 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c07e1a9a-64b6-434d-b239-54f1e7d574ce tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:54.137686 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c07e1a9a-64b6-434d-b239-54f1e7d574ce tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:54.151703 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c07e1a9a-64b6-434d-b239-54f1e7d574ce tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:54.152092 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c07e1a9a-64b6-434d-b239-54f1e7d574ce tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:54.192584 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-c07e1a9a-64b6-434d-b239-54f1e7d574ce tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] HTTP exception thrown: Cannot 'attach_volume' instance eda4760f-be50-4efe-808f-d4ab2c0358f4 while it is in vm_state rescued Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c07e1a9a-64b6-434d-b239-54f1e7d574ce tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Request method failure captured: Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: POST /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4/os-volume_attachments HTTP/1.1 Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 74 Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIZV3OGXS0Y0dMCJR3JsNV5yeizCzXf9d_TuViBBFaAqgn8TDP7z7jkssGhxEzL2Hkj8d0DyUdQPhy8rCBCc-PskzFupuPpZKa-RVGVZcBl67AuQkQbqQObAzrPZ5DBpyPNMKv8zeY6EtLRNUIutKSaCaDQe1MRr7gfF_WIm51FEcc Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: ac8c0850e1ac43e7913a88dbb7b7e9f8 Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 00:57:54.196894 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 00:57:54.198295 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8c0850e1ac43e7913a88dbb7b7e9f8", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:57:54.198295 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 00:57:54.198295 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: ac8c0850e1ac43e7913a88dbb7b7e9f8 Sep 11 00:57:54.198295 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 00:57:54.198295 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-ServerRescueNegativeTestJSON-2141619617-project Sep 11 00:57:54.198295 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 00:57:54.198295 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 00:57:54.198295 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 03a3c989ecef42e084fb44d47c55b27e Sep 11 00:57:54.198295 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2141619617-project Sep 11 00:57:54.198295 dv-cinder-master-3-smb devstack@n-api.service[120496]: Sep 11 00:57:54.198295 dv-cinder-master-3-smb devstack@n-api.service[120496]: {"volumeAttachment": {"volumeId": "adcfb648-f28d-4d34-8642-c7fd91bd7492"}} Sep 11 00:57:54.198295 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Cannot 'attach_volume' instance eda4760f-be50-4efe-808f-d4ab2c0358f4 while it is in vm_state rescued Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'server_id': 'eda4760f-be50-4efe-808f-d4ab2c0358f4', 'body': {'volumeAttachment': {'volumeId': 'adcfb648-f28d-4d34-8642-c7fd91bd7492'}}} Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eda4760f-be50-4efe-808f-d4ab2c0358f4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:57:54.199079 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance eda4760f-be50-4efe-808f-d4ab2c0358f4 while it is in vm_state rescued Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:57:54.201461 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:57:54.202705 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:57:54.202705 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:57:54.202705 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance eda4760f-be50-4efe-808f-d4ab2c0358f4 while it is in vm_state rescued Sep 11 00:57:54.202705 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:57:54.208940 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c07e1a9a-64b6-434d-b239-54f1e7d574ce tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Returning 409 to user: Cannot 'attach_volume' instance eda4760f-be50-4efe-808f-d4ab2c0358f4 while it is in vm_state rescued {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:57:54.210079 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c07e1a9a-64b6-434d-b239-54f1e7d574ce tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "POST /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.095211 Sep 11 00:57:54.212142 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 140/273] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Sep 11 00:57:54 2022] POST /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4/os-volume_attachments => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 11 00:57:54.220128 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7ecaf43e-b694-4143-9f27-77c31bf4d6bb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:54.220963 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7ecaf43e-b694-4143-9f27-77c31bf4d6bb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:54.232227 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ecaf43e-b694-4143-9f27-77c31bf4d6bb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:54.232994 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ecaf43e-b694-4143-9f27-77c31bf4d6bb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:54.233621 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ecaf43e-b694-4143-9f27-77c31bf4d6bb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:54.234524 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ecaf43e-b694-4143-9f27-77c31bf4d6bb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:54.235262 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ecaf43e-b694-4143-9f27-77c31bf4d6bb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:54.235756 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ecaf43e-b694-4143-9f27-77c31bf4d6bb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:54.322246 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a4543edc-8096-4dce-990b-8311ccc4217d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:54.336290 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a4543edc-8096-4dce-990b-8311ccc4217d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1366 microversion: 2.1 time: 0.265416 Sep 11 00:57:54.337106 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 134/274] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:54 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:54.342177 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c6220f61-11e2-43fa-b790-90c4c7ad9a6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:54.343014 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c6220f61-11e2-43fa-b790-90c4c7ad9a6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:54.349919 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c6220f61-11e2-43fa-b790-90c4c7ad9a6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:54.350693 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c6220f61-11e2-43fa-b790-90c4c7ad9a6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:54.351680 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c6220f61-11e2-43fa-b790-90c4c7ad9a6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:54.352655 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c6220f61-11e2-43fa-b790-90c4c7ad9a6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:54.353446 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c6220f61-11e2-43fa-b790-90c4c7ad9a6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:54.354067 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c6220f61-11e2-43fa-b790-90c4c7ad9a6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:54.388317 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7ecaf43e-b694-4143-9f27-77c31bf4d6bb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "POST /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4/action" status: 202 len: 0 microversion: 2.1 time: 0.172390 Sep 11 00:57:54.392949 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 141/275] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Sep 11 00:57:54 2022] POST /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 00:57:54.406289 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-658d72b0-9c9b-4092-8198-2e9c1858db2f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:54.407073 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-658d72b0-9c9b-4092-8198-2e9c1858db2f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:54.436978 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-658d72b0-9c9b-4092-8198-2e9c1858db2f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:54.440175 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-658d72b0-9c9b-4092-8198-2e9c1858db2f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:54.440866 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-658d72b0-9c9b-4092-8198-2e9c1858db2f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:54.441825 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-658d72b0-9c9b-4092-8198-2e9c1858db2f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:54.444193 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-658d72b0-9c9b-4092-8198-2e9c1858db2f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:54.446286 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-658d72b0-9c9b-4092-8198-2e9c1858db2f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:55.010182 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-658d72b0-9c9b-4092-8198-2e9c1858db2f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:55.021763 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c6220f61-11e2-43fa-b790-90c4c7ad9a6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:55.023349 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-658d72b0-9c9b-4092-8198-2e9c1858db2f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1508 microversion: 2.1 time: 0.627889 Sep 11 00:57:55.023949 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 142/276] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:54 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1508 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:55.045309 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c6220f61-11e2-43fa-b790-90c4c7ad9a6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1722 microversion: 2.1 time: 0.704336 Sep 11 00:57:55.052906 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 135/277] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:54 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1722 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:55.110837 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a0752468-0808-4147-b30b-1895aef4fe3f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:55.113078 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a0752468-0808-4147-b30b-1895aef4fe3f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:55.124893 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0752468-0808-4147-b30b-1895aef4fe3f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:55.131894 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0752468-0808-4147-b30b-1895aef4fe3f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:55.132621 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0752468-0808-4147-b30b-1895aef4fe3f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:55.133642 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0752468-0808-4147-b30b-1895aef4fe3f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:55.134300 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0752468-0808-4147-b30b-1895aef4fe3f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:55.137081 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0752468-0808-4147-b30b-1895aef4fe3f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:55.368020 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-fcfb1d83-be49-4125-bff9-dfdcc9dbb052 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:55.369236 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-fcfb1d83-be49-4125-bff9-dfdcc9dbb052 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:55.386766 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fcfb1d83-be49-4125-bff9-dfdcc9dbb052 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:55.387343 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fcfb1d83-be49-4125-bff9-dfdcc9dbb052 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:55.387721 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fcfb1d83-be49-4125-bff9-dfdcc9dbb052 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:55.388443 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fcfb1d83-be49-4125-bff9-dfdcc9dbb052 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:55.389149 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fcfb1d83-be49-4125-bff9-dfdcc9dbb052 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:55.389584 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fcfb1d83-be49-4125-bff9-dfdcc9dbb052 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:55.566136 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a0752468-0808-4147-b30b-1895aef4fe3f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:55.578715 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a0752468-0808-4147-b30b-1895aef4fe3f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:55.585170 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a0752468-0808-4147-b30b-1895aef4fe3f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:55.586701 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a0752468-0808-4147-b30b-1895aef4fe3f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.480063 Sep 11 00:57:55.587611 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 143/278] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:55 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:55.845058 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-fcfb1d83-be49-4125-bff9-dfdcc9dbb052 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:55.862686 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-fcfb1d83-be49-4125-bff9-dfdcc9dbb052 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1366 microversion: 2.1 time: 0.499137 Sep 11 00:57:55.888635 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 136/279] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:55 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1366 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:56.056398 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-15722913-d84b-4d79-a9c3-385bee91fec1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:56.057315 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-15722913-d84b-4d79-a9c3-385bee91fec1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:56.066754 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15722913-d84b-4d79-a9c3-385bee91fec1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:56.074906 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6fa89a25-d981-42ff-86fd-2787cc1b8aef tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:56.076159 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6fa89a25-d981-42ff-86fd-2787cc1b8aef tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:56.082730 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6fa89a25-d981-42ff-86fd-2787cc1b8aef tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:56.085781 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15722913-d84b-4d79-a9c3-385bee91fec1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:56.090124 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15722913-d84b-4d79-a9c3-385bee91fec1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:56.090978 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6fa89a25-d981-42ff-86fd-2787cc1b8aef tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:56.091916 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15722913-d84b-4d79-a9c3-385bee91fec1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:56.092507 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6fa89a25-d981-42ff-86fd-2787cc1b8aef tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:56.093133 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15722913-d84b-4d79-a9c3-385bee91fec1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:56.095234 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6fa89a25-d981-42ff-86fd-2787cc1b8aef tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:56.096196 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6fa89a25-d981-42ff-86fd-2787cc1b8aef tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:56.098286 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6fa89a25-d981-42ff-86fd-2787cc1b8aef tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:56.099768 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15722913-d84b-4d79-a9c3-385bee91fec1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:56.343150 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-15722913-d84b-4d79-a9c3-385bee91fec1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:56.351676 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-15722913-d84b-4d79-a9c3-385bee91fec1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1508 microversion: 2.1 time: 0.302166 Sep 11 00:57:56.352251 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 144/280] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:56 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:56.371657 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6fa89a25-d981-42ff-86fd-2787cc1b8aef tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:56.384303 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6fa89a25-d981-42ff-86fd-2787cc1b8aef tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1722 microversion: 2.1 time: 0.313681 Sep 11 00:57:56.404382 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 137/281] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:56 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:56.616911 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4cf1e93f-28c4-4a61-8143-5c6c210513af tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:56.619151 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4cf1e93f-28c4-4a61-8143-5c6c210513af tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:56.622933 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-f9b18fe9-ca8c-4f8b-aa89-72a09338d8e1 req-b6562997-5077-4ae1-b09c-75e788dd4f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a384877e-aaf3-4e9c-b99c-f98084c2ebab", "name": "network-vif-plugged", "status": "completed", "tag": "d347821a-deb0-4b3c-b6d4-e1f4f98e348f"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:56.633173 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-f9b18fe9-ca8c-4f8b-aa89-72a09338d8e1 req-b6562997-5077-4ae1-b09c-75e788dd4f5d service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:56.633670 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-f9b18fe9-ca8c-4f8b-aa89-72a09338d8e1 req-b6562997-5077-4ae1-b09c-75e788dd4f5d service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:56.634105 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-f9b18fe9-ca8c-4f8b-aa89-72a09338d8e1 req-b6562997-5077-4ae1-b09c-75e788dd4f5d service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:56.636584 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4cf1e93f-28c4-4a61-8143-5c6c210513af tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:56.637265 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4cf1e93f-28c4-4a61-8143-5c6c210513af tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:56.637706 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4cf1e93f-28c4-4a61-8143-5c6c210513af tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:56.638420 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4cf1e93f-28c4-4a61-8143-5c6c210513af tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:56.638872 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4cf1e93f-28c4-4a61-8143-5c6c210513af tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:56.639509 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4cf1e93f-28c4-4a61-8143-5c6c210513af tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:56.646806 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-f9b18fe9-ca8c-4f8b-aa89-72a09338d8e1 req-b6562997-5077-4ae1-b09c-75e788dd4f5d service nova] Creating event network-vif-plugged:d347821a-deb0-4b3c-b6d4-e1f4f98e348f for instance a384877e-aaf3-4e9c-b99c-f98084c2ebab on hv-cinder-maste Sep 11 00:57:56.652078 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-f9b18fe9-ca8c-4f8b-aa89-72a09338d8e1 req-b6562997-5077-4ae1-b09c-75e788dd4f5d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033101 Sep 11 00:57:56.653474 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 138/282] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:57:56.782948 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4cf1e93f-28c4-4a61-8143-5c6c210513af tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:56.793570 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4cf1e93f-28c4-4a61-8143-5c6c210513af tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:56.795006 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4cf1e93f-28c4-4a61-8143-5c6c210513af tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:56.796223 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4cf1e93f-28c4-4a61-8143-5c6c210513af tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.183336 Sep 11 00:57:56.796776 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 145/283] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:56 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:56.889839 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-53b3052a-3de7-4e77-be44-62c2035de337 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:56.890524 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-53b3052a-3de7-4e77-be44-62c2035de337 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:56.896908 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-53b3052a-3de7-4e77-be44-62c2035de337 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:56.897393 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-53b3052a-3de7-4e77-be44-62c2035de337 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:56.897818 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-53b3052a-3de7-4e77-be44-62c2035de337 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:56.898512 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-53b3052a-3de7-4e77-be44-62c2035de337 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:56.898951 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-53b3052a-3de7-4e77-be44-62c2035de337 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:56.899414 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-53b3052a-3de7-4e77-be44-62c2035de337 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:57.036348 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-53b3052a-3de7-4e77-be44-62c2035de337 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:57.045690 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-53b3052a-3de7-4e77-be44-62c2035de337 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1366 microversion: 2.1 time: 0.161542 Sep 11 00:57:57.046273 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 139/284] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:56 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:57.389742 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-83b5ced1-01ef-4a90-9dba-78352075de92 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:57.390431 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-83b5ced1-01ef-4a90-9dba-78352075de92 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:57.397455 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-83b5ced1-01ef-4a90-9dba-78352075de92 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:57.397943 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-83b5ced1-01ef-4a90-9dba-78352075de92 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:57.398428 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-83b5ced1-01ef-4a90-9dba-78352075de92 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:57.399106 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-83b5ced1-01ef-4a90-9dba-78352075de92 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:57.399835 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-83b5ced1-01ef-4a90-9dba-78352075de92 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:57.400258 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-83b5ced1-01ef-4a90-9dba-78352075de92 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:57.425269 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3d933632-eefe-45a0-8f3f-af2d0f60566a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:57.426487 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3d933632-eefe-45a0-8f3f-af2d0f60566a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:57.432829 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3d933632-eefe-45a0-8f3f-af2d0f60566a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:57.433505 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3d933632-eefe-45a0-8f3f-af2d0f60566a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:57.434100 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3d933632-eefe-45a0-8f3f-af2d0f60566a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:57.435207 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3d933632-eefe-45a0-8f3f-af2d0f60566a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:57.435901 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3d933632-eefe-45a0-8f3f-af2d0f60566a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:57.436467 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3d933632-eefe-45a0-8f3f-af2d0f60566a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:57.665320 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-83b5ced1-01ef-4a90-9dba-78352075de92 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:57.668611 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:57.687457 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-83b5ced1-01ef-4a90-9dba-78352075de92 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1508 microversion: 2.1 time: 0.301648 Sep 11 00:57:57.687959 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 146/285] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:57 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:57.703465 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3d933632-eefe-45a0-8f3f-af2d0f60566a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:57.703739 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-707766186", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "networks": [{"uuid": "166d9243-0d0d-4778-89ab-03cbc34d3928"}]}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:57:57.705191 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3d933632-eefe-45a0-8f3f-af2d0f60566a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1722 microversion: 2.1 time: 0.284001 Sep 11 00:57:57.706435 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 140/286] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:57 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:57.828190 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-1dd13411-372d-42f5-a944-2bb13130337c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:57.829418 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-1dd13411-372d-42f5-a944-2bb13130337c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:57.838254 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1dd13411-372d-42f5-a944-2bb13130337c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:57.838832 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1dd13411-372d-42f5-a944-2bb13130337c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:57.839795 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1dd13411-372d-42f5-a944-2bb13130337c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:57.840866 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1dd13411-372d-42f5-a944-2bb13130337c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:57.841832 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1dd13411-372d-42f5-a944-2bb13130337c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:57.843275 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1dd13411-372d-42f5-a944-2bb13130337c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:58.008752 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1dd13411-372d-42f5-a944-2bb13130337c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:58.021712 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1dd13411-372d-42f5-a944-2bb13130337c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:58.023607 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1dd13411-372d-42f5-a944-2bb13130337c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:58.025161 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-1dd13411-372d-42f5-a944-2bb13130337c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.202754 Sep 11 00:57:58.026336 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 141/287] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:57 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:57:58.068542 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-bdd7aac4-d83b-4143-b1b7-c7f4478c7cd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:58.069171 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-bdd7aac4-d83b-4143-b1b7-c7f4478c7cd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:58.075348 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdd7aac4-d83b-4143-b1b7-c7f4478c7cd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:58.075799 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdd7aac4-d83b-4143-b1b7-c7f4478c7cd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:58.076226 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdd7aac4-d83b-4143-b1b7-c7f4478c7cd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:58.076905 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdd7aac4-d83b-4143-b1b7-c7f4478c7cd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:58.077389 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdd7aac4-d83b-4143-b1b7-c7f4478c7cd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:58.077804 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdd7aac4-d83b-4143-b1b7-c7f4478c7cd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:58.224934 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-bdd7aac4-d83b-4143-b1b7-c7f4478c7cd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:58.233202 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-bdd7aac4-d83b-4143-b1b7-c7f4478c7cd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1366 microversion: 2.1 time: 0.168406 Sep 11 00:57:58.233708 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 142/288] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:58 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:57:58.714825 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3b89f598-2d88-45df-8e6b-c8a638633c87 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:58.715649 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3b89f598-2d88-45df-8e6b-c8a638633c87 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:58.721975 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b89f598-2d88-45df-8e6b-c8a638633c87 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:58.722465 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b89f598-2d88-45df-8e6b-c8a638633c87 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:58.722907 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b89f598-2d88-45df-8e6b-c8a638633c87 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:58.723920 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b89f598-2d88-45df-8e6b-c8a638633c87 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:58.724543 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b89f598-2d88-45df-8e6b-c8a638633c87 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:58.725109 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b89f598-2d88-45df-8e6b-c8a638633c87 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:58.892388 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3b89f598-2d88-45df-8e6b-c8a638633c87 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:58.901325 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3b89f598-2d88-45df-8e6b-c8a638633c87 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1514 microversion: 2.1 time: 0.190624 Sep 11 00:57:58.901904 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 143/289] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:58 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:58.906834 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-00fb4ee8-11a5-4234-b10b-166393420196 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:58.907672 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-00fb4ee8-11a5-4234-b10b-166393420196 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:58.913740 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-00fb4ee8-11a5-4234-b10b-166393420196 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:58.914235 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-00fb4ee8-11a5-4234-b10b-166393420196 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:58.914779 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-00fb4ee8-11a5-4234-b10b-166393420196 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:58.920006 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-00fb4ee8-11a5-4234-b10b-166393420196 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:58.920783 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-00fb4ee8-11a5-4234-b10b-166393420196 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:58.921332 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-00fb4ee8-11a5-4234-b10b-166393420196 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:59.119242 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-00fb4ee8-11a5-4234-b10b-166393420196 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:59.130715 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-00fb4ee8-11a5-4234-b10b-166393420196 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1722 microversion: 2.1 time: 0.227443 Sep 11 00:57:59.147657 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 144/290] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:58 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:57:59.147657 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-349786cf-25f7-4da9-9ffc-247bcc355207 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:59.147657 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-349786cf-25f7-4da9-9ffc-247bcc355207 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:59.147657 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-349786cf-25f7-4da9-9ffc-247bcc355207 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:59.148095 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-349786cf-25f7-4da9-9ffc-247bcc355207 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:59.148095 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-349786cf-25f7-4da9-9ffc-247bcc355207 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:59.148095 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-349786cf-25f7-4da9-9ffc-247bcc355207 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:59.148095 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-349786cf-25f7-4da9-9ffc-247bcc355207 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:59.148379 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-349786cf-25f7-4da9-9ffc-247bcc355207 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:59.336596 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-349786cf-25f7-4da9-9ffc-247bcc355207 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:59.346116 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-349786cf-25f7-4da9-9ffc-247bcc355207 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:59.347982 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-349786cf-25f7-4da9-9ffc-247bcc355207 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:59.349429 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-349786cf-25f7-4da9-9ffc-247bcc355207 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.217002 Sep 11 00:57:59.351387 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 145/291] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:57:59 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:57:59.356862 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-408b4c6a-01f6-417d-b1c3-c510f111b758 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:57:59.357735 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-408b4c6a-01f6-417d-b1c3-c510f111b758 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:57:59.364284 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-408b4c6a-01f6-417d-b1c3-c510f111b758 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:59.365233 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-408b4c6a-01f6-417d-b1c3-c510f111b758 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:59.368416 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-408b4c6a-01f6-417d-b1c3-c510f111b758 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:59.369507 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-408b4c6a-01f6-417d-b1c3-c510f111b758 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:57:59.370160 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-408b4c6a-01f6-417d-b1c3-c510f111b758 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:57:59.370976 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-408b4c6a-01f6-417d-b1c3-c510f111b758 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:57:59.521789 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-408b4c6a-01f6-417d-b1c3-c510f111b758 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:57:59.531648 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-408b4c6a-01f6-417d-b1c3-c510f111b758 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1366 microversion: 2.1 time: 0.178888 Sep 11 00:57:59.532524 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 146/292] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:57:59 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:00.154932 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-622ddc41-d561-4361-aa21-dda96636f0f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:00.155707 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-622ddc41-d561-4361-aa21-dda96636f0f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:00.162459 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-622ddc41-d561-4361-aa21-dda96636f0f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:00.162951 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-622ddc41-d561-4361-aa21-dda96636f0f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:00.163420 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-622ddc41-d561-4361-aa21-dda96636f0f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:00.164115 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-622ddc41-d561-4361-aa21-dda96636f0f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:00.164555 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-622ddc41-d561-4361-aa21-dda96636f0f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:00.164968 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-622ddc41-d561-4361-aa21-dda96636f0f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:00.301108 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-622ddc41-d561-4361-aa21-dda96636f0f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:00.309715 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-622ddc41-d561-4361-aa21-dda96636f0f0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1722 microversion: 2.1 time: 0.159010 Sep 11 00:58:00.310281 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 147/293] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:00 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:00.378623 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-43f2d8ed-29df-4c5a-a2fa-2fe58d9a61f8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:00.379736 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-43f2d8ed-29df-4c5a-a2fa-2fe58d9a61f8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:00.386507 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-43f2d8ed-29df-4c5a-a2fa-2fe58d9a61f8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:00.386994 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-43f2d8ed-29df-4c5a-a2fa-2fe58d9a61f8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:00.387951 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-43f2d8ed-29df-4c5a-a2fa-2fe58d9a61f8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:00.388388 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-43f2d8ed-29df-4c5a-a2fa-2fe58d9a61f8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:00.388823 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-43f2d8ed-29df-4c5a-a2fa-2fe58d9a61f8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:00.389447 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-43f2d8ed-29df-4c5a-a2fa-2fe58d9a61f8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:00.532734 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-43f2d8ed-29df-4c5a-a2fa-2fe58d9a61f8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:00.542067 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-43f2d8ed-29df-4c5a-a2fa-2fe58d9a61f8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:00.544523 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-43f2d8ed-29df-4c5a-a2fa-2fe58d9a61f8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:00.545901 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-43f2d8ed-29df-4c5a-a2fa-2fe58d9a61f8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.171700 Sep 11 00:58:00.546455 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 148/294] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:00 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:58:00.552946 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-2553922f-60e6-45c1-a158-b9ec67125133 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Action: 'create', calling method: .version_select at 0x7fbb9081e670>, body: {"keypair": {"name": "tempest-keypair-1369128276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgAel0qh8LwsN4n6g0SKdoMGrZyydFFA8P9Niu+2WfLL2QmCPc753zlkAquOEGVJs36q+4U96pkDFWsKGVduf1YkWWv3IobahGpXtEz/WLKEqFeDp5XAkEeur0Ty9I7WA=="}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:00.572440 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-2553922f-60e6-45c1-a158-b9ec67125133 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Getting quotas for project ac8c0850e1ac43e7913a88dbb7b7e9f8. Resources: {'key_pairs'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:58:00.580003 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-2553922f-60e6-45c1-a158-b9ec67125133 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Getting quotas for user 03a3c989ecef42e084fb44d47c55b27e and project ac8c0850e1ac43e7913a88dbb7b7e9f8. Resources: {'key_pairs'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:58:00.609675 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-2553922f-60e6-45c1-a158-b9ec67125133 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062198 Sep 11 00:58:00.617063 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 149/295] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Sep 11 00:58:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:58:00.617063 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-7c1b4ebf-58de-4706-a134-87c1eb98c5d3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:00.617063 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-7c1b4ebf-58de-4706-a134-87c1eb98c5d3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:00.632140 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7c1b4ebf-58de-4706-a134-87c1eb98c5d3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:00.633290 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7c1b4ebf-58de-4706-a134-87c1eb98c5d3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:00.633821 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7c1b4ebf-58de-4706-a134-87c1eb98c5d3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:00.634638 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7c1b4ebf-58de-4706-a134-87c1eb98c5d3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:00.635411 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7c1b4ebf-58de-4706-a134-87c1eb98c5d3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:00.635901 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7c1b4ebf-58de-4706-a134-87c1eb98c5d3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:00.906804 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-7c1b4ebf-58de-4706-a134-87c1eb98c5d3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:00.922190 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-7c1b4ebf-58de-4706-a134-87c1eb98c5d3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1366 microversion: 2.1 time: 0.310293 Sep 11 00:58:00.923980 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 150/296] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:00 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:01.333034 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-379ef560-0779-4689-90c1-db48da40b729 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:01.333767 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-379ef560-0779-4689-90c1-db48da40b729 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:01.343639 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-379ef560-0779-4689-90c1-db48da40b729 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:01.344711 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-379ef560-0779-4689-90c1-db48da40b729 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:01.346577 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-379ef560-0779-4689-90c1-db48da40b729 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:01.347608 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-379ef560-0779-4689-90c1-db48da40b729 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:01.348069 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-379ef560-0779-4689-90c1-db48da40b729 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:01.348667 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-379ef560-0779-4689-90c1-db48da40b729 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:01.582373 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-379ef560-0779-4689-90c1-db48da40b729 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:01.599461 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-379ef560-0779-4689-90c1-db48da40b729 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1722 microversion: 2.1 time: 0.270608 Sep 11 00:58:01.600390 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 151/297] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:01 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:58:01.622025 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-bfd2f018-9978-48a5-81b8-aa1cedf06cea tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:01.623522 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-bfd2f018-9978-48a5-81b8-aa1cedf06cea tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:01.628779 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bfd2f018-9978-48a5-81b8-aa1cedf06cea tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:01.629259 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bfd2f018-9978-48a5-81b8-aa1cedf06cea tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:01.629916 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bfd2f018-9978-48a5-81b8-aa1cedf06cea tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:01.630784 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bfd2f018-9978-48a5-81b8-aa1cedf06cea tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:01.631437 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bfd2f018-9978-48a5-81b8-aa1cedf06cea tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:01.631862 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bfd2f018-9978-48a5-81b8-aa1cedf06cea tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:01.636338 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=100 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:01.863791 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-bfd2f018-9978-48a5-81b8-aa1cedf06cea tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:01.874574 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-bfd2f018-9978-48a5-81b8-aa1cedf06cea tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:01.879156 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-bfd2f018-9978-48a5-81b8-aa1cedf06cea tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:01.880736 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-bfd2f018-9978-48a5-81b8-aa1cedf06cea tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.263740 Sep 11 00:58:01.881296 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 152/298] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:01 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:01.947339 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-348c9359-9bbd-4198-a1b4-b3ff6fc3c49c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:01.948121 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-348c9359-9bbd-4198-a1b4-b3ff6fc3c49c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:01.964794 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-348c9359-9bbd-4198-a1b4-b3ff6fc3c49c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:01.966006 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-348c9359-9bbd-4198-a1b4-b3ff6fc3c49c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:01.966452 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-348c9359-9bbd-4198-a1b4-b3ff6fc3c49c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:01.967194 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-348c9359-9bbd-4198-a1b4-b3ff6fc3c49c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:01.967656 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-348c9359-9bbd-4198-a1b4-b3ff6fc3c49c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:01.968083 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-348c9359-9bbd-4198-a1b4-b3ff6fc3c49c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:02.252908 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-348c9359-9bbd-4198-a1b4-b3ff6fc3c49c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:02.263759 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-348c9359-9bbd-4198-a1b4-b3ff6fc3c49c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1556 microversion: 2.1 time: 0.320940 Sep 11 00:58:02.279373 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 153/299] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:01 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1556 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:58:02.311407 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ad03497e-173d-45d6-8e54-e4f5a2104236 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:02.312279 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ad03497e-173d-45d6-8e54-e4f5a2104236 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:02.323115 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ad03497e-173d-45d6-8e54-e4f5a2104236 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:02.323896 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ad03497e-173d-45d6-8e54-e4f5a2104236 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:02.324951 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ad03497e-173d-45d6-8e54-e4f5a2104236 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:02.325938 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ad03497e-173d-45d6-8e54-e4f5a2104236 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:02.326736 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ad03497e-173d-45d6-8e54-e4f5a2104236 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:02.327443 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ad03497e-173d-45d6-8e54-e4f5a2104236 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:02.744159 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ad03497e-173d-45d6-8e54-e4f5a2104236 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.440428 Sep 11 00:58:02.745981 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 154/300] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Sep 11 00:58:02 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab/os-interface => generated 284 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:58:02.750953 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-297c82f7-c7ee-4f8b-be6b-2db26da1a4c0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:02.751590 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-297c82f7-c7ee-4f8b-be6b-2db26da1a4c0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:02.758253 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-297c82f7-c7ee-4f8b-be6b-2db26da1a4c0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:02.758773 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-297c82f7-c7ee-4f8b-be6b-2db26da1a4c0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:02.759606 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-297c82f7-c7ee-4f8b-be6b-2db26da1a4c0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:02.760877 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-297c82f7-c7ee-4f8b-be6b-2db26da1a4c0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:02.761702 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-297c82f7-c7ee-4f8b-be6b-2db26da1a4c0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:02.762518 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-297c82f7-c7ee-4f8b-be6b-2db26da1a4c0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:02.952193 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-297c82f7-c7ee-4f8b-be6b-2db26da1a4c0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:02.968014 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-297c82f7-c7ee-4f8b-be6b-2db26da1a4c0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1722 microversion: 2.1 time: 0.220029 Sep 11 00:58:02.968560 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 155/301] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:02 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:02.974198 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-fa333ee8-442b-4660-8bc6-80086a6a7efc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:02.974814 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-fa333ee8-442b-4660-8bc6-80086a6a7efc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:02.983048 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa333ee8-442b-4660-8bc6-80086a6a7efc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:02.983908 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa333ee8-442b-4660-8bc6-80086a6a7efc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:02.984352 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa333ee8-442b-4660-8bc6-80086a6a7efc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:02.985484 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa333ee8-442b-4660-8bc6-80086a6a7efc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:02.985950 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa333ee8-442b-4660-8bc6-80086a6a7efc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:02.986375 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa333ee8-442b-4660-8bc6-80086a6a7efc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:03.161781 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-fa333ee8-442b-4660-8bc6-80086a6a7efc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:03.172424 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-fa333ee8-442b-4660-8bc6-80086a6a7efc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:03.173858 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-fa333ee8-442b-4660-8bc6-80086a6a7efc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:03.175050 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-fa333ee8-442b-4660-8bc6-80086a6a7efc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.205675 Sep 11 00:58:03.195202 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 156/302] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:02 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:03.195202 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1652695338", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1a0b51b-f6ee-4db0-9e52-fee1b0240c49"}], "security_groups": [{"name": "tempest-securitygroup--2049859821"}], "key_name": "tempest-keypair-1369128276", "user_data": "}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:05.491876 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] validate_networks() for [('166d9243-0d0d-4778-89ab-03cbc34d3928', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:58:05.614509 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.network.neutron [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] validate_networks() for [('b1a0b51b-f6ee-4db0-9e52-fee1b0240c49', None, None, None, None, None)] {{(pid=120497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:58:06.147083 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:58:06.147733 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:58:06.148618 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:58:06.148990 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:58:06.149346 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:58:06.161173 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:06.162045 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:06.162704 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:06.163673 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:06.166510 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:06.168236 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:06.190267 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Getting quotas for project 20163c9fb6a5490f9ad676ac84fe411b. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:58:06.202204 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Getting quotas for user 6ca9626cd8bd4341ba7d26e76f34b533 and project 20163c9fb6a5490f9ad676ac84fe411b. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:58:06.218507 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:58:06.221696 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:58:06.268014 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Flavor limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:58:06.268653 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Image limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:58:06.269303 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Flavor pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:58:06.270026 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Image pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:58:06.270627 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:58:06.282223 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:06.282778 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:06.283557 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:06.284098 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:06.284544 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:06.284962 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:06.318812 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Getting quotas for project ac8c0850e1ac43e7913a88dbb7b7e9f8. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:58:06.319608 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-33f8eeff-1022-405b-b7b5-5d9cbdbb0ed7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.630327 Sep 11 00:58:06.320556 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 147/303] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 00:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 8632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:58:06.328732 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Getting quotas for user 03a3c989ecef42e084fb44d47c55b27e and project ac8c0850e1ac43e7913a88dbb7b7e9f8. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:58:06.332097 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-50a2f63d-96ea-49f3-86f9-83362a629a9c req-7eabe17c-616d-42af-80f5-c1ec90096260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a384877e-aaf3-4e9c-b99c-f98084c2ebab", "tag": "d347821a-deb0-4b3c-b6d4-e1f4f98e348f"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:06.343640 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-50a2f63d-96ea-49f3-86f9-83362a629a9c req-7eabe17c-616d-42af-80f5-c1ec90096260 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:06.344356 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-50a2f63d-96ea-49f3-86f9-83362a629a9c req-7eabe17c-616d-42af-80f5-c1ec90096260 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:06.344926 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-50a2f63d-96ea-49f3-86f9-83362a629a9c req-7eabe17c-616d-42af-80f5-c1ec90096260 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:06.356081 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Going to run 1 instances... {{(pid=120497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:58:06.359798 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:58:06.367223 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-50a2f63d-96ea-49f3-86f9-83362a629a9c req-7eabe17c-616d-42af-80f5-c1ec90096260 service nova] Creating event network-changed:d347821a-deb0-4b3c-b6d4-e1f4f98e348f for instance a384877e-aaf3-4e9c-b99c-f98084c2ebab on hv-cinder-maste Sep 11 00:58:06.374462 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-50a2f63d-96ea-49f3-86f9-83362a629a9c req-7eabe17c-616d-42af-80f5-c1ec90096260 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045707 Sep 11 00:58:06.375789 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 148/304] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:58:06.382364 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5a771f1e-6918-4145-be0c-5325963ba62e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:06.383207 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5a771f1e-6918-4145-be0c-5325963ba62e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:06.390779 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a771f1e-6918-4145-be0c-5325963ba62e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:06.391473 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a771f1e-6918-4145-be0c-5325963ba62e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:06.391807 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a771f1e-6918-4145-be0c-5325963ba62e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:06.392505 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a771f1e-6918-4145-be0c-5325963ba62e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:06.392948 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a771f1e-6918-4145-be0c-5325963ba62e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:06.393362 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a771f1e-6918-4145-be0c-5325963ba62e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:06.449694 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d5ea7395-d3c4-4339-aad6-4b2df0a1ab99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.264225 Sep 11 00:58:06.453016 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 157/305] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 00:58:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 3272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:58:06.472637 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-9758b4f5-8071-4afd-8d2a-0d0d28732d5c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:06.473365 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-9758b4f5-8071-4afd-8d2a-0d0d28732d5c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:06.522494 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9758b4f5-8071-4afd-8d2a-0d0d28732d5c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:06.523240 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9758b4f5-8071-4afd-8d2a-0d0d28732d5c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:06.523773 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9758b4f5-8071-4afd-8d2a-0d0d28732d5c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:06.528940 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9758b4f5-8071-4afd-8d2a-0d0d28732d5c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:06.529539 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9758b4f5-8071-4afd-8d2a-0d0d28732d5c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:06.531034 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9758b4f5-8071-4afd-8d2a-0d0d28732d5c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:06.979449 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-5a771f1e-6918-4145-be0c-5325963ba62e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:06.998239 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5a771f1e-6918-4145-be0c-5325963ba62e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1699 microversion: 2.1 time: 0.621051 Sep 11 00:58:07.003097 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 149/306] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:06 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1699 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:07.012360 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-9758b4f5-8071-4afd-8d2a-0d0d28732d5c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:07.019074 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-08967d31-adec-4cef-8107-05761a3f8c77 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:07.024875 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-08967d31-adec-4cef-8107-05761a3f8c77 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:07.026241 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-9758b4f5-8071-4afd-8d2a-0d0d28732d5c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:07.030939 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-9758b4f5-8071-4afd-8d2a-0d0d28732d5c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:07.032179 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-9758b4f5-8071-4afd-8d2a-0d0d28732d5c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.576030 Sep 11 00:58:07.032735 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 158/307] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:06 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:07.075645 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f235f146-2a93-4471-86ae-ea5da069f5e0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:07.076265 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f235f146-2a93-4471-86ae-ea5da069f5e0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:07.259634 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-08967d31-adec-4cef-8107-05761a3f8c77 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:07.272802 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-08967d31-adec-4cef-8107-05761a3f8c77 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1218 microversion: 2.1 time: 0.265679 Sep 11 00:58:07.273838 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 150/308] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:07 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1218 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:07.291206 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aa5485f1-647e-433f-8336-6b26e72e240c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:07.300784 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa5485f1-647e-433f-8336-6b26e72e240c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:07.302537 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa5485f1-647e-433f-8336-6b26e72e240c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:07.303443 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa5485f1-647e-433f-8336-6b26e72e240c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:07.338389 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-aa5485f1-647e-433f-8336-6b26e72e240c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Going to try to start instance {{(pid=120496) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 11 00:58:07.403361 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f235f146-2a93-4471-86ae-ea5da069f5e0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:07.418735 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f235f146-2a93-4471-86ae-ea5da069f5e0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1246 microversion: 2.1 time: 0.356594 Sep 11 00:58:07.420596 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 159/309] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:07 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1246 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:07.438649 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-aa5485f1-647e-433f-8336-6b26e72e240c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "POST /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/action" status: 202 len: 0 microversion: 2.1 time: 0.153532 Sep 11 00:58:07.443275 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 151/310] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Sep 11 00:58:07 2022] POST /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:58:07.456627 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-7e1fc5c4-885e-45af-be3c-b8d7292f519e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:07.462236 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-7e1fc5c4-885e-45af-be3c-b8d7292f519e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:07.477414 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7e1fc5c4-885e-45af-be3c-b8d7292f519e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:07.478206 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7e1fc5c4-885e-45af-be3c-b8d7292f519e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:07.478871 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7e1fc5c4-885e-45af-be3c-b8d7292f519e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:07.491619 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7e1fc5c4-885e-45af-be3c-b8d7292f519e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:07.492501 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7e1fc5c4-885e-45af-be3c-b8d7292f519e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:07.493179 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7e1fc5c4-885e-45af-be3c-b8d7292f519e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:07.686618 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-7e1fc5c4-885e-45af-be3c-b8d7292f519e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:07.696108 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-7e1fc5c4-885e-45af-be3c-b8d7292f519e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1708 microversion: 2.1 time: 0.250620 Sep 11 00:58:07.699659 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 160/311] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:07 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1708 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:08.067423 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e9222d30-f824-4ac7-8c84-608c166ce23d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:08.068259 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e9222d30-f824-4ac7-8c84-608c166ce23d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:08.075510 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e9222d30-f824-4ac7-8c84-608c166ce23d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:08.076313 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e9222d30-f824-4ac7-8c84-608c166ce23d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:08.076992 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e9222d30-f824-4ac7-8c84-608c166ce23d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:08.078285 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e9222d30-f824-4ac7-8c84-608c166ce23d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:08.079089 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e9222d30-f824-4ac7-8c84-608c166ce23d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:08.079597 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e9222d30-f824-4ac7-8c84-608c166ce23d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:08.267130 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e9222d30-f824-4ac7-8c84-608c166ce23d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:08.276799 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e9222d30-f824-4ac7-8c84-608c166ce23d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:08.278632 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e9222d30-f824-4ac7-8c84-608c166ce23d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:08.279842 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e9222d30-f824-4ac7-8c84-608c166ce23d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.217933 Sep 11 00:58:08.280421 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 152/312] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:08 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:08.303375 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c54fde9d-f68d-41e6-bbba-f034d2ef2808 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:08.304611 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c54fde9d-f68d-41e6-bbba-f034d2ef2808 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:08.311898 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c54fde9d-f68d-41e6-bbba-f034d2ef2808 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:08.312583 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c54fde9d-f68d-41e6-bbba-f034d2ef2808 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:08.313171 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c54fde9d-f68d-41e6-bbba-f034d2ef2808 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:08.314028 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c54fde9d-f68d-41e6-bbba-f034d2ef2808 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:08.314633 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c54fde9d-f68d-41e6-bbba-f034d2ef2808 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:08.315332 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c54fde9d-f68d-41e6-bbba-f034d2ef2808 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:08.414040 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c54fde9d-f68d-41e6-bbba-f034d2ef2808 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:08.425037 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c54fde9d-f68d-41e6-bbba-f034d2ef2808 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1214 microversion: 2.1 time: 0.125526 Sep 11 00:58:08.426238 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 161/313] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:08 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:08.444097 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4f8ce994-1e7d-4a96-b12e-27bc7834b7fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:08.444710 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4f8ce994-1e7d-4a96-b12e-27bc7834b7fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:08.450763 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f8ce994-1e7d-4a96-b12e-27bc7834b7fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:08.451346 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f8ce994-1e7d-4a96-b12e-27bc7834b7fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:08.451840 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f8ce994-1e7d-4a96-b12e-27bc7834b7fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:08.452735 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f8ce994-1e7d-4a96-b12e-27bc7834b7fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:08.453190 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f8ce994-1e7d-4a96-b12e-27bc7834b7fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:08.453812 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f8ce994-1e7d-4a96-b12e-27bc7834b7fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:08.566777 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4f8ce994-1e7d-4a96-b12e-27bc7834b7fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:08.575445 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4f8ce994-1e7d-4a96-b12e-27bc7834b7fe tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1298 microversion: 2.1 time: 0.135168 Sep 11 00:58:08.576387 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 153/314] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:08 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1298 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:08.732030 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ef1cf2d8-7d4c-48ea-afe2-968b0868dcdc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:08.732811 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ef1cf2d8-7d4c-48ea-afe2-968b0868dcdc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:08.744852 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef1cf2d8-7d4c-48ea-afe2-968b0868dcdc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:08.748387 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef1cf2d8-7d4c-48ea-afe2-968b0868dcdc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:08.748842 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef1cf2d8-7d4c-48ea-afe2-968b0868dcdc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:08.755733 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef1cf2d8-7d4c-48ea-afe2-968b0868dcdc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:08.758390 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef1cf2d8-7d4c-48ea-afe2-968b0868dcdc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:08.760020 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef1cf2d8-7d4c-48ea-afe2-968b0868dcdc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:09.050101 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ef1cf2d8-7d4c-48ea-afe2-968b0868dcdc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:09.060034 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ef1cf2d8-7d4c-48ea-afe2-968b0868dcdc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1708 microversion: 2.1 time: 0.332262 Sep 11 00:58:09.075219 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 162/315] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:08 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1708 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:09.309010 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-10cd6318-b425-4e47-ba73-a08a9e8185a9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:09.312748 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-10cd6318-b425-4e47-ba73-a08a9e8185a9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:09.320290 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-10cd6318-b425-4e47-ba73-a08a9e8185a9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:09.320983 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-10cd6318-b425-4e47-ba73-a08a9e8185a9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:09.321559 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-10cd6318-b425-4e47-ba73-a08a9e8185a9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:09.322869 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-10cd6318-b425-4e47-ba73-a08a9e8185a9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:09.323488 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-10cd6318-b425-4e47-ba73-a08a9e8185a9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:09.324050 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-10cd6318-b425-4e47-ba73-a08a9e8185a9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:09.451014 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-2ab7a2e9-9de5-4464-bee7-55ae17676d7d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:09.456500 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-2ab7a2e9-9de5-4464-bee7-55ae17676d7d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:09.471938 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2ab7a2e9-9de5-4464-bee7-55ae17676d7d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:09.472426 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2ab7a2e9-9de5-4464-bee7-55ae17676d7d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:09.472858 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2ab7a2e9-9de5-4464-bee7-55ae17676d7d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:09.473564 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2ab7a2e9-9de5-4464-bee7-55ae17676d7d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:09.475480 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2ab7a2e9-9de5-4464-bee7-55ae17676d7d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:09.476832 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2ab7a2e9-9de5-4464-bee7-55ae17676d7d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:09.773364 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-10cd6318-b425-4e47-ba73-a08a9e8185a9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:09.775253 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-2ab7a2e9-9de5-4464-bee7-55ae17676d7d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:09.790919 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-2ab7a2e9-9de5-4464-bee7-55ae17676d7d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1270 microversion: 2.1 time: 0.343835 Sep 11 00:58:09.793203 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-10cd6318-b425-4e47-ba73-a08a9e8185a9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:09.795911 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 163/316] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:09 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1270 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:09.808430 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-10cd6318-b425-4e47-ba73-a08a9e8185a9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:09.808430 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-10cd6318-b425-4e47-ba73-a08a9e8185a9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.497660 Sep 11 00:58:09.808430 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 154/317] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:09 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:09.818067 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c11bd299-8c64-4130-abde-234d0e7ad001 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:09.818605 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c11bd299-8c64-4130-abde-234d0e7ad001 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:09.839750 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c11bd299-8c64-4130-abde-234d0e7ad001 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:09.841210 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c11bd299-8c64-4130-abde-234d0e7ad001 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:09.842496 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c11bd299-8c64-4130-abde-234d0e7ad001 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:09.844812 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c11bd299-8c64-4130-abde-234d0e7ad001 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:09.847206 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c11bd299-8c64-4130-abde-234d0e7ad001 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:09.847766 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c11bd299-8c64-4130-abde-234d0e7ad001 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:09.933626 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c11bd299-8c64-4130-abde-234d0e7ad001 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:09.943853 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c11bd299-8c64-4130-abde-234d0e7ad001 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1304 microversion: 2.1 time: 0.146163 Sep 11 00:58:09.944621 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 164/318] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:09 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:10.084763 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-592b104a-4b04-4dd2-863d-4f1e1bc61612 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:10.085691 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-592b104a-4b04-4dd2-863d-4f1e1bc61612 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:10.097647 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-592b104a-4b04-4dd2-863d-4f1e1bc61612 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:10.098531 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-592b104a-4b04-4dd2-863d-4f1e1bc61612 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:10.099219 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-592b104a-4b04-4dd2-863d-4f1e1bc61612 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:10.100186 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-592b104a-4b04-4dd2-863d-4f1e1bc61612 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:10.100709 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-592b104a-4b04-4dd2-863d-4f1e1bc61612 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:10.101232 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-592b104a-4b04-4dd2-863d-4f1e1bc61612 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:10.355424 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-592b104a-4b04-4dd2-863d-4f1e1bc61612 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:10.367172 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-592b104a-4b04-4dd2-863d-4f1e1bc61612 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1712 microversion: 2.1 time: 0.286493 Sep 11 00:58:10.380319 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 155/319] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:10 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1712 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:10.818766 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a3e84371-567f-41ed-b57a-ed0976dab0a9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:10.820446 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a3e84371-567f-41ed-b57a-ed0976dab0a9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:10.832380 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aca8424f-2897-4b4b-b572-81da88e577e5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:10.832911 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-aca8424f-2897-4b4b-b572-81da88e577e5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:10.847321 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aca8424f-2897-4b4b-b572-81da88e577e5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:10.847815 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aca8424f-2897-4b4b-b572-81da88e577e5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:10.848247 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aca8424f-2897-4b4b-b572-81da88e577e5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:10.852863 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a3e84371-567f-41ed-b57a-ed0976dab0a9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:10.853358 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a3e84371-567f-41ed-b57a-ed0976dab0a9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:10.853827 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a3e84371-567f-41ed-b57a-ed0976dab0a9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:10.854549 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a3e84371-567f-41ed-b57a-ed0976dab0a9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:10.854999 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a3e84371-567f-41ed-b57a-ed0976dab0a9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:10.855450 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a3e84371-567f-41ed-b57a-ed0976dab0a9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:10.858407 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aca8424f-2897-4b4b-b572-81da88e577e5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:10.858910 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aca8424f-2897-4b4b-b572-81da88e577e5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:10.859368 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aca8424f-2897-4b4b-b572-81da88e577e5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:10.980519 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a3e84371-567f-41ed-b57a-ed0976dab0a9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:10.992900 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a3e84371-567f-41ed-b57a-ed0976dab0a9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1278 microversion: 2.1 time: 0.178670 Sep 11 00:58:10.994340 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 165/320] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:10 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:58:11.007810 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-501d5117-4633-48de-8c29-ef368ba14726 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:11.010192 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-501d5117-4633-48de-8c29-ef368ba14726 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:11.025055 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-501d5117-4633-48de-8c29-ef368ba14726 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:11.026054 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-501d5117-4633-48de-8c29-ef368ba14726 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:11.028755 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-501d5117-4633-48de-8c29-ef368ba14726 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:11.029760 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-501d5117-4633-48de-8c29-ef368ba14726 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:11.033510 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-501d5117-4633-48de-8c29-ef368ba14726 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:11.034308 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-501d5117-4633-48de-8c29-ef368ba14726 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:11.357637 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-501d5117-4633-48de-8c29-ef368ba14726 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:11.365681 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-501d5117-4633-48de-8c29-ef368ba14726 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1372 microversion: 2.1 time: 0.370159 Sep 11 00:58:11.370245 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 166/321] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:10 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1372 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:11.430211 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-aca8424f-2897-4b4b-b572-81da88e577e5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:11.460892 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-aca8424f-2897-4b4b-b572-81da88e577e5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:11.465013 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-aca8424f-2897-4b4b-b572-81da88e577e5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:11.468796 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-aca8424f-2897-4b4b-b572-81da88e577e5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.639168 Sep 11 00:58:11.473469 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 156/322] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:10 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:58:12.022614 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-cbe70253-84eb-4063-b1f7-6f54f8eb6006 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:12.023857 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-cbe70253-84eb-4063-b1f7-6f54f8eb6006 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:12.035090 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cbe70253-84eb-4063-b1f7-6f54f8eb6006 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:12.037146 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cbe70253-84eb-4063-b1f7-6f54f8eb6006 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:12.037599 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cbe70253-84eb-4063-b1f7-6f54f8eb6006 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:12.038328 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cbe70253-84eb-4063-b1f7-6f54f8eb6006 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:12.038766 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cbe70253-84eb-4063-b1f7-6f54f8eb6006 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:12.040962 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cbe70253-84eb-4063-b1f7-6f54f8eb6006 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:12.397328 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4c1636f6-e8a1-477c-ad51-26d42dc3c12b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:12.399038 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4c1636f6-e8a1-477c-ad51-26d42dc3c12b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:12.415130 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-cbe70253-84eb-4063-b1f7-6f54f8eb6006 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:12.428120 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c1636f6-e8a1-477c-ad51-26d42dc3c12b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:12.430033 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c1636f6-e8a1-477c-ad51-26d42dc3c12b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:12.432358 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c1636f6-e8a1-477c-ad51-26d42dc3c12b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:12.433363 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-cbe70253-84eb-4063-b1f7-6f54f8eb6006 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1318 microversion: 2.1 time: 0.411891 Sep 11 00:58:12.435886 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c1636f6-e8a1-477c-ad51-26d42dc3c12b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:12.436644 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c1636f6-e8a1-477c-ad51-26d42dc3c12b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:12.438730 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c1636f6-e8a1-477c-ad51-26d42dc3c12b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:12.451308 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 167/323] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:12 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:12.501537 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-760bee94-fc58-43b3-b933-cab8674f1033 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:12.502149 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-760bee94-fc58-43b3-b933-cab8674f1033 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:12.523257 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-760bee94-fc58-43b3-b933-cab8674f1033 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:12.525708 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-760bee94-fc58-43b3-b933-cab8674f1033 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:12.528419 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-760bee94-fc58-43b3-b933-cab8674f1033 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:12.531328 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-760bee94-fc58-43b3-b933-cab8674f1033 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:12.536480 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-760bee94-fc58-43b3-b933-cab8674f1033 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:12.536927 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-760bee94-fc58-43b3-b933-cab8674f1033 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:12.863984 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4c1636f6-e8a1-477c-ad51-26d42dc3c12b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:12.904106 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4c1636f6-e8a1-477c-ad51-26d42dc3c12b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1372 microversion: 2.1 time: 0.488955 Sep 11 00:58:12.909105 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 157/324] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:12 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1372 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:12.957226 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-760bee94-fc58-43b3-b933-cab8674f1033 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:12.973687 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-760bee94-fc58-43b3-b933-cab8674f1033 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:12.977784 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-760bee94-fc58-43b3-b933-cab8674f1033 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:12.982216 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-760bee94-fc58-43b3-b933-cab8674f1033 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.487242 Sep 11 00:58:12.991228 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 168/325] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:12 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:58:13.121912 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-35857be7-8407-4720-8b0b-9c0b60bb7fdc req-e990dd53-81cc-4025-87af-d81f721347ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56cf74eb-5098-47e8-b99c-efd0af892b66", "tag": "5ae85da6-bc81-47ad-9baf-b2583a2b801b"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:13.136898 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-35857be7-8407-4720-8b0b-9c0b60bb7fdc req-e990dd53-81cc-4025-87af-d81f721347ac service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:13.137511 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-35857be7-8407-4720-8b0b-9c0b60bb7fdc req-e990dd53-81cc-4025-87af-d81f721347ac service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:13.138012 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-35857be7-8407-4720-8b0b-9c0b60bb7fdc req-e990dd53-81cc-4025-87af-d81f721347ac service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:13.149711 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-35857be7-8407-4720-8b0b-9c0b60bb7fdc req-e990dd53-81cc-4025-87af-d81f721347ac service nova] Creating event network-changed:5ae85da6-bc81-47ad-9baf-b2583a2b801b for instance 56cf74eb-5098-47e8-b99c-efd0af892b66 on hv-cinder-maste Sep 11 00:58:13.158179 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-35857be7-8407-4720-8b0b-9c0b60bb7fdc req-e990dd53-81cc-4025-87af-d81f721347ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047276 Sep 11 00:58:13.159023 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 158/326] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:58:13.467017 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-88f97a82-5f64-4704-869f-03ee5856e766 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:13.468721 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-88f97a82-5f64-4704-869f-03ee5856e766 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:13.471865 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:13.484107 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-88f97a82-5f64-4704-869f-03ee5856e766 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:13.485840 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-88f97a82-5f64-4704-869f-03ee5856e766 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:13.486506 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-88f97a82-5f64-4704-869f-03ee5856e766 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:13.487942 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-88f97a82-5f64-4704-869f-03ee5856e766 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:13.488691 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-88f97a82-5f64-4704-869f-03ee5856e766 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:13.489282 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-88f97a82-5f64-4704-869f-03ee5856e766 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:13.622905 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-76d6b859-fa2d-4fb4-9366-a9e75c74b4a4 req-2ed4c943-f2e7-4515-8b57-9eea48c752cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84067194-1977-4b94-8372-f37a77fe546f", "tag": "607691ae-ff58-42f0-b303-e48fad3480bb"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:13.635609 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-76d6b859-fa2d-4fb4-9366-a9e75c74b4a4 req-2ed4c943-f2e7-4515-8b57-9eea48c752cd service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:13.636336 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-76d6b859-fa2d-4fb4-9366-a9e75c74b4a4 req-2ed4c943-f2e7-4515-8b57-9eea48c752cd service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:13.636950 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-76d6b859-fa2d-4fb4-9366-a9e75c74b4a4 req-2ed4c943-f2e7-4515-8b57-9eea48c752cd service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:13.651123 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-76d6b859-fa2d-4fb4-9366-a9e75c74b4a4 req-2ed4c943-f2e7-4515-8b57-9eea48c752cd service nova] Creating event network-changed:607691ae-ff58-42f0-b303-e48fad3480bb for instance 84067194-1977-4b94-8372-f37a77fe546f on hv-cinder-maste Sep 11 00:58:13.657217 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-76d6b859-fa2d-4fb4-9366-a9e75c74b4a4 req-2ed4c943-f2e7-4515-8b57-9eea48c752cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038268 Sep 11 00:58:13.658364 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 159/327] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:58:13.776738 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-88f97a82-5f64-4704-869f-03ee5856e766 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:13.784748 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-88f97a82-5f64-4704-869f-03ee5856e766 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1318 microversion: 2.1 time: 0.324519 Sep 11 00:58:13.801403 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 169/328] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:13 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:13.933807 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-59156f9f-29ba-4bbf-a553-48655a59aca8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:13.934883 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-59156f9f-29ba-4bbf-a553-48655a59aca8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:13.945310 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59156f9f-29ba-4bbf-a553-48655a59aca8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:13.948379 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59156f9f-29ba-4bbf-a553-48655a59aca8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:13.949062 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59156f9f-29ba-4bbf-a553-48655a59aca8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:13.949991 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59156f9f-29ba-4bbf-a553-48655a59aca8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:13.950651 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59156f9f-29ba-4bbf-a553-48655a59aca8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:13.951356 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59156f9f-29ba-4bbf-a553-48655a59aca8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:14.015683 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-aeeed343-027a-4c37-8645-6a1946f7e0ed tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:14.017816 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-aeeed343-027a-4c37-8645-6a1946f7e0ed tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:14.026153 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-aeeed343-027a-4c37-8645-6a1946f7e0ed tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:14.028294 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-aeeed343-027a-4c37-8645-6a1946f7e0ed tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:14.028952 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-aeeed343-027a-4c37-8645-6a1946f7e0ed tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:14.029976 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-aeeed343-027a-4c37-8645-6a1946f7e0ed tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:14.030638 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-aeeed343-027a-4c37-8645-6a1946f7e0ed tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:14.031308 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-aeeed343-027a-4c37-8645-6a1946f7e0ed tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:14.274442 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-59156f9f-29ba-4bbf-a553-48655a59aca8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:14.286412 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-59156f9f-29ba-4bbf-a553-48655a59aca8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1372 microversion: 2.1 time: 0.356958 Sep 11 00:58:14.287036 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 160/329] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:13 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1372 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:14.302034 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-aeeed343-027a-4c37-8645-6a1946f7e0ed tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:14.302034 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=100 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:14.321472 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-aeeed343-027a-4c37-8645-6a1946f7e0ed tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:14.331958 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-aeeed343-027a-4c37-8645-6a1946f7e0ed tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:14.333940 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-aeeed343-027a-4c37-8645-6a1946f7e0ed tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.322417 Sep 11 00:58:14.334821 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 170/330] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:14 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:14.811310 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-398d29db-8c1e-4d75-a549-62dea056361b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:14.812002 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-398d29db-8c1e-4d75-a549-62dea056361b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:14.819429 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-398d29db-8c1e-4d75-a549-62dea056361b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:14.819927 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-398d29db-8c1e-4d75-a549-62dea056361b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:14.820364 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-398d29db-8c1e-4d75-a549-62dea056361b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:14.821082 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-398d29db-8c1e-4d75-a549-62dea056361b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:14.821531 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-398d29db-8c1e-4d75-a549-62dea056361b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:14.821922 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-398d29db-8c1e-4d75-a549-62dea056361b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:14.992909 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-398d29db-8c1e-4d75-a549-62dea056361b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:15.003697 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-398d29db-8c1e-4d75-a549-62dea056361b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1318 microversion: 2.1 time: 0.196522 Sep 11 00:58:15.020649 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 161/331] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:14 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:15.316721 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-00418a2c-b483-4e81-ba89-3d1d7125f986 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:15.317593 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-00418a2c-b483-4e81-ba89-3d1d7125f986 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:15.328790 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-00418a2c-b483-4e81-ba89-3d1d7125f986 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:15.329243 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-00418a2c-b483-4e81-ba89-3d1d7125f986 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:15.329857 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-00418a2c-b483-4e81-ba89-3d1d7125f986 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:15.331836 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-00418a2c-b483-4e81-ba89-3d1d7125f986 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:15.332749 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-00418a2c-b483-4e81-ba89-3d1d7125f986 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:15.333182 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-00418a2c-b483-4e81-ba89-3d1d7125f986 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:15.367355 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f49d9b12-5ecc-4a0a-97b1-d4bca12f6417 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:15.369591 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f49d9b12-5ecc-4a0a-97b1-d4bca12f6417 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:15.383155 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f49d9b12-5ecc-4a0a-97b1-d4bca12f6417 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:15.386465 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f49d9b12-5ecc-4a0a-97b1-d4bca12f6417 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:15.387074 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f49d9b12-5ecc-4a0a-97b1-d4bca12f6417 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:15.388494 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f49d9b12-5ecc-4a0a-97b1-d4bca12f6417 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:15.389675 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f49d9b12-5ecc-4a0a-97b1-d4bca12f6417 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:15.390610 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f49d9b12-5ecc-4a0a-97b1-d4bca12f6417 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:15.564383 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-00418a2c-b483-4e81-ba89-3d1d7125f986 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:15.574211 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-00418a2c-b483-4e81-ba89-3d1d7125f986 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1372 microversion: 2.1 time: 0.266531 Sep 11 00:58:15.582789 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 171/332] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:15 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1372 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:15.632569 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f49d9b12-5ecc-4a0a-97b1-d4bca12f6417 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:15.643342 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f49d9b12-5ecc-4a0a-97b1-d4bca12f6417 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:15.645966 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f49d9b12-5ecc-4a0a-97b1-d4bca12f6417 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:15.647431 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f49d9b12-5ecc-4a0a-97b1-d4bca12f6417 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.284546 Sep 11 00:58:15.648550 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 162/333] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:15 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:16.029722 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-41922951-382f-47fc-8fbb-817b785b5165 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:16.030333 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-41922951-382f-47fc-8fbb-817b785b5165 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:16.038149 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-41922951-382f-47fc-8fbb-817b785b5165 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:16.038752 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-41922951-382f-47fc-8fbb-817b785b5165 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:16.039138 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-41922951-382f-47fc-8fbb-817b785b5165 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:16.039940 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-41922951-382f-47fc-8fbb-817b785b5165 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:16.040488 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-41922951-382f-47fc-8fbb-817b785b5165 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:16.041012 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-41922951-382f-47fc-8fbb-817b785b5165 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:16.211849 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-41922951-382f-47fc-8fbb-817b785b5165 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:16.220620 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-41922951-382f-47fc-8fbb-817b785b5165 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1318 microversion: 2.1 time: 0.194988 Sep 11 00:58:16.236416 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 172/334] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:16 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:16.602066 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bfd44921-c936-4be7-b3de-d202f02efff7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:16.603515 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bfd44921-c936-4be7-b3de-d202f02efff7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:16.611967 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:16.614141 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bfd44921-c936-4be7-b3de-d202f02efff7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:16.619591 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bfd44921-c936-4be7-b3de-d202f02efff7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:16.622218 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bfd44921-c936-4be7-b3de-d202f02efff7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:16.622984 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bfd44921-c936-4be7-b3de-d202f02efff7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:16.623484 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bfd44921-c936-4be7-b3de-d202f02efff7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:16.623909 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bfd44921-c936-4be7-b3de-d202f02efff7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:16.679249 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-853ba73a-e126-4742-99d8-b329783bb62b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:16.680369 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-853ba73a-e126-4742-99d8-b329783bb62b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:16.682531 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=2 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:16.702913 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-853ba73a-e126-4742-99d8-b329783bb62b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:16.706078 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-853ba73a-e126-4742-99d8-b329783bb62b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:16.706959 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-853ba73a-e126-4742-99d8-b329783bb62b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:16.707890 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-853ba73a-e126-4742-99d8-b329783bb62b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:16.708406 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-853ba73a-e126-4742-99d8-b329783bb62b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:16.711347 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-853ba73a-e126-4742-99d8-b329783bb62b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:17.085744 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-bfd44921-c936-4be7-b3de-d202f02efff7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:17.095671 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bfd44921-c936-4be7-b3de-d202f02efff7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1372 microversion: 2.1 time: 0.497505 Sep 11 00:58:17.095985 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 163/335] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:16 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1372 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:17.110101 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-853ba73a-e126-4742-99d8-b329783bb62b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:17.119001 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-853ba73a-e126-4742-99d8-b329783bb62b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:17.122003 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-853ba73a-e126-4742-99d8-b329783bb62b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:17.123884 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-853ba73a-e126-4742-99d8-b329783bb62b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.449692 Sep 11 00:58:17.129196 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 173/336] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:16 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:58:17.244368 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1e58f389-f275-4d2e-a5cf-d2c30b330108 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:17.245523 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1e58f389-f275-4d2e-a5cf-d2c30b330108 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:17.252647 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e58f389-f275-4d2e-a5cf-d2c30b330108 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:17.253367 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e58f389-f275-4d2e-a5cf-d2c30b330108 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:17.253952 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e58f389-f275-4d2e-a5cf-d2c30b330108 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:17.254996 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e58f389-f275-4d2e-a5cf-d2c30b330108 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:17.255627 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e58f389-f275-4d2e-a5cf-d2c30b330108 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:17.256201 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e58f389-f275-4d2e-a5cf-d2c30b330108 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:17.275709 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=8 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:17.433967 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1e58f389-f275-4d2e-a5cf-d2c30b330108 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:17.443568 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1e58f389-f275-4d2e-a5cf-d2c30b330108 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1318 microversion: 2.1 time: 0.203485 Sep 11 00:58:17.444754 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 164/337] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:17 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:18.120147 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ea4aaec0-0427-431b-8cdc-e368044766e5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:18.120768 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ea4aaec0-0427-431b-8cdc-e368044766e5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:18.122869 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=12 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:18.134046 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ea4aaec0-0427-431b-8cdc-e368044766e5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:18.134661 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ea4aaec0-0427-431b-8cdc-e368044766e5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:18.136208 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ea4aaec0-0427-431b-8cdc-e368044766e5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:18.136999 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ea4aaec0-0427-431b-8cdc-e368044766e5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:18.137477 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ea4aaec0-0427-431b-8cdc-e368044766e5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:18.137901 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ea4aaec0-0427-431b-8cdc-e368044766e5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:18.173297 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d2a580f2-797d-4743-8418-1e65df429a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:18.174538 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d2a580f2-797d-4743-8418-1e65df429a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:18.186532 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2a580f2-797d-4743-8418-1e65df429a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:18.190609 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2a580f2-797d-4743-8418-1e65df429a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:18.195340 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2a580f2-797d-4743-8418-1e65df429a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:18.200176 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2a580f2-797d-4743-8418-1e65df429a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:18.200176 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2a580f2-797d-4743-8418-1e65df429a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:18.200176 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2a580f2-797d-4743-8418-1e65df429a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:18.527484 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-d2a580f2-797d-4743-8418-1e65df429a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:18.543802 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-d2a580f2-797d-4743-8418-1e65df429a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:18.545259 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-d2a580f2-797d-4743-8418-1e65df429a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:18.546458 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d2a580f2-797d-4743-8418-1e65df429a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.377123 Sep 11 00:58:18.547022 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 165/338] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:18 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:18.560026 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ea4aaec0-0427-431b-8cdc-e368044766e5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:18.560328 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-37a49669-0a4d-40d5-9728-2dcff7933a28 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:18.560328 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-37a49669-0a4d-40d5-9728-2dcff7933a28 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:18.567544 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ea4aaec0-0427-431b-8cdc-e368044766e5 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1372 microversion: 2.1 time: 0.451287 Sep 11 00:58:18.568780 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 174/339] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:18 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1372 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:18.577467 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37a49669-0a4d-40d5-9728-2dcff7933a28 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:18.578546 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37a49669-0a4d-40d5-9728-2dcff7933a28 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:18.579300 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37a49669-0a4d-40d5-9728-2dcff7933a28 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:18.580429 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37a49669-0a4d-40d5-9728-2dcff7933a28 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:18.581100 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37a49669-0a4d-40d5-9728-2dcff7933a28 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:18.581752 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37a49669-0a4d-40d5-9728-2dcff7933a28 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:18.586916 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:18.837937 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-37a49669-0a4d-40d5-9728-2dcff7933a28 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:18.847773 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-37a49669-0a4d-40d5-9728-2dcff7933a28 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1318 microversion: 2.1 time: 0.294403 Sep 11 00:58:18.855236 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 166/340] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:18 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:19.039388 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-98287c17-3af5-4d65-bc2f-00f3458290ad req-66cf9645-3d14-4ab3-9914-d212a5e10880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56cf74eb-5098-47e8-b99c-efd0af892b66", "name": "network-vif-plugged", "status": "completed", "tag": "5ae85da6-bc81-47ad-9baf-b2583a2b801b"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:19.074777 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-98287c17-3af5-4d65-bc2f-00f3458290ad req-66cf9645-3d14-4ab3-9914-d212a5e10880 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:19.075443 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-98287c17-3af5-4d65-bc2f-00f3458290ad req-66cf9645-3d14-4ab3-9914-d212a5e10880 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:19.075877 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-98287c17-3af5-4d65-bc2f-00f3458290ad req-66cf9645-3d14-4ab3-9914-d212a5e10880 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:19.092364 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-98287c17-3af5-4d65-bc2f-00f3458290ad req-66cf9645-3d14-4ab3-9914-d212a5e10880 service nova] Creating event network-vif-plugged:5ae85da6-bc81-47ad-9baf-b2583a2b801b for instance 56cf74eb-5098-47e8-b99c-efd0af892b66 on hv-cinder-maste Sep 11 00:58:19.112128 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-98287c17-3af5-4d65-bc2f-00f3458290ad req-66cf9645-3d14-4ab3-9914-d212a5e10880 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076594 Sep 11 00:58:19.112954 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 175/341] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:58:19.576073 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aa11e8de-6f14-42fb-9ca7-b8d8d7b5250a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:19.577406 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-aa11e8de-6f14-42fb-9ca7-b8d8d7b5250a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:19.586206 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa11e8de-6f14-42fb-9ca7-b8d8d7b5250a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:19.586624 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa11e8de-6f14-42fb-9ca7-b8d8d7b5250a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:19.587167 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa11e8de-6f14-42fb-9ca7-b8d8d7b5250a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:19.587983 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa11e8de-6f14-42fb-9ca7-b8d8d7b5250a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:19.588637 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa11e8de-6f14-42fb-9ca7-b8d8d7b5250a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:19.594721 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-60b8237a-a22a-431e-bdda-8b873127b14a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:19.595446 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-60b8237a-a22a-431e-bdda-8b873127b14a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:19.599315 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa11e8de-6f14-42fb-9ca7-b8d8d7b5250a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:19.603227 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-60b8237a-a22a-431e-bdda-8b873127b14a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:19.603980 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-60b8237a-a22a-431e-bdda-8b873127b14a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:19.604592 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-60b8237a-a22a-431e-bdda-8b873127b14a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:19.605305 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-60b8237a-a22a-431e-bdda-8b873127b14a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:19.605904 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-60b8237a-a22a-431e-bdda-8b873127b14a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:19.606525 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-60b8237a-a22a-431e-bdda-8b873127b14a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:19.825156 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-60b8237a-a22a-431e-bdda-8b873127b14a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:19.828220 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-aa11e8de-6f14-42fb-9ca7-b8d8d7b5250a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:19.833694 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-60b8237a-a22a-431e-bdda-8b873127b14a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1372 microversion: 2.1 time: 0.243241 Sep 11 00:58:19.834909 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 176/342] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:19 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1372 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:58:19.837209 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-aa11e8de-6f14-42fb-9ca7-b8d8d7b5250a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:19.838763 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-aa11e8de-6f14-42fb-9ca7-b8d8d7b5250a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:19.840009 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-aa11e8de-6f14-42fb-9ca7-b8d8d7b5250a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1740 microversion: 2.20 time: 0.268395 Sep 11 00:58:19.857355 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 167/343] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:19 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1740 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:19.874706 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-2151f238-1786-4119-baf0-672319d5730b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:19.875466 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-2151f238-1786-4119-baf0-672319d5730b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:19.882434 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2151f238-1786-4119-baf0-672319d5730b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:19.882949 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2151f238-1786-4119-baf0-672319d5730b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:19.883665 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2151f238-1786-4119-baf0-672319d5730b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:19.884521 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2151f238-1786-4119-baf0-672319d5730b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:19.885155 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2151f238-1786-4119-baf0-672319d5730b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:19.885636 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2151f238-1786-4119-baf0-672319d5730b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:20.070083 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-2151f238-1786-4119-baf0-672319d5730b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:20.078593 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-2151f238-1786-4119-baf0-672319d5730b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1318 microversion: 2.1 time: 0.208487 Sep 11 00:58:20.079253 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 177/344] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:19 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:20.856976 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8493009e-b544-40c6-963f-f2c7c5f041cd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:20.857594 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8493009e-b544-40c6-963f-f2c7c5f041cd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:20.865381 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:20.866136 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8572962a-ead6-434e-9242-c2bb04dab598 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:20.866847 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-8572962a-ead6-434e-9242-c2bb04dab598 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:20.868227 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8493009e-b544-40c6-963f-f2c7c5f041cd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:20.868742 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8493009e-b544-40c6-963f-f2c7c5f041cd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:20.869413 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8493009e-b544-40c6-963f-f2c7c5f041cd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:20.870197 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8493009e-b544-40c6-963f-f2c7c5f041cd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:20.870826 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8493009e-b544-40c6-963f-f2c7c5f041cd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:20.871263 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8493009e-b544-40c6-963f-f2c7c5f041cd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:20.876337 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8572962a-ead6-434e-9242-c2bb04dab598 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:20.876819 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8572962a-ead6-434e-9242-c2bb04dab598 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:20.877250 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8572962a-ead6-434e-9242-c2bb04dab598 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:20.878053 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8572962a-ead6-434e-9242-c2bb04dab598 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:20.881456 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8572962a-ead6-434e-9242-c2bb04dab598 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:20.881939 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8572962a-ead6-434e-9242-c2bb04dab598 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:21.089239 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8493009e-b544-40c6-963f-f2c7c5f041cd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:21.099614 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8493009e-b544-40c6-963f-f2c7c5f041cd tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1372 microversion: 2.1 time: 0.246223 Sep 11 00:58:21.102215 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 168/345] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:20 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1372 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:21.110908 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e4640174-ae31-4ba1-955b-c53c6ef26a5d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:21.111989 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e4640174-ae31-4ba1-955b-c53c6ef26a5d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:21.115056 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8572962a-ead6-434e-9242-c2bb04dab598 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:21.123710 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8572962a-ead6-434e-9242-c2bb04dab598 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:21.126795 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8572962a-ead6-434e-9242-c2bb04dab598 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:21.128020 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e4640174-ae31-4ba1-955b-c53c6ef26a5d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:21.128180 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8572962a-ead6-434e-9242-c2bb04dab598 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1722 microversion: 2.20 time: 0.266061 Sep 11 00:58:21.128812 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e4640174-ae31-4ba1-955b-c53c6ef26a5d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:21.128954 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 178/346] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:20 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:21.129484 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e4640174-ae31-4ba1-955b-c53c6ef26a5d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:21.130254 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e4640174-ae31-4ba1-955b-c53c6ef26a5d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:21.130921 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e4640174-ae31-4ba1-955b-c53c6ef26a5d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:21.131463 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e4640174-ae31-4ba1-955b-c53c6ef26a5d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:21.134404 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-87c5f022-1e91-4135-b21e-028ea1fc6e40 req-c67e7b5c-fe9b-413d-8162-30cc31f3a57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84067194-1977-4b94-8372-f37a77fe546f", "name": "network-vif-plugged", "status": "completed", "tag": "607691ae-ff58-42f0-b303-e48fad3480bb"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:21.144904 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-87c5f022-1e91-4135-b21e-028ea1fc6e40 req-c67e7b5c-fe9b-413d-8162-30cc31f3a57c service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:21.145592 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-87c5f022-1e91-4135-b21e-028ea1fc6e40 req-c67e7b5c-fe9b-413d-8162-30cc31f3a57c service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:21.146235 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-87c5f022-1e91-4135-b21e-028ea1fc6e40 req-c67e7b5c-fe9b-413d-8162-30cc31f3a57c service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:21.159037 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-87c5f022-1e91-4135-b21e-028ea1fc6e40 req-c67e7b5c-fe9b-413d-8162-30cc31f3a57c service nova] Creating event network-vif-plugged:607691ae-ff58-42f0-b303-e48fad3480bb for instance 84067194-1977-4b94-8372-f37a77fe546f on hv-cinder-maste Sep 11 00:58:21.165774 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-87c5f022-1e91-4135-b21e-028ea1fc6e40 req-c67e7b5c-fe9b-413d-8162-30cc31f3a57c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035193 Sep 11 00:58:21.166758 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 179/347] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:58:21.296446 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e4640174-ae31-4ba1-955b-c53c6ef26a5d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:21.304736 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e4640174-ae31-4ba1-955b-c53c6ef26a5d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1318 microversion: 2.1 time: 0.201232 Sep 11 00:58:21.305305 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 169/348] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:21 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:22.128364 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-cce424a9-9cd0-4ebb-8cea-1d479d14f1bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:22.129078 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-cce424a9-9cd0-4ebb-8cea-1d479d14f1bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:22.136518 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cce424a9-9cd0-4ebb-8cea-1d479d14f1bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:22.137402 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cce424a9-9cd0-4ebb-8cea-1d479d14f1bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:22.138353 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cce424a9-9cd0-4ebb-8cea-1d479d14f1bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:22.139783 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cce424a9-9cd0-4ebb-8cea-1d479d14f1bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:22.140248 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cce424a9-9cd0-4ebb-8cea-1d479d14f1bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:22.140679 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cce424a9-9cd0-4ebb-8cea-1d479d14f1bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:22.157057 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f2b00391-a515-4d3c-9806-1ed48d640cfc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:22.157646 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f2b00391-a515-4d3c-9806-1ed48d640cfc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:22.165524 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f2b00391-a515-4d3c-9806-1ed48d640cfc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:22.166161 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f2b00391-a515-4d3c-9806-1ed48d640cfc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:22.166533 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f2b00391-a515-4d3c-9806-1ed48d640cfc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:22.170373 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f2b00391-a515-4d3c-9806-1ed48d640cfc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:22.170837 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f2b00391-a515-4d3c-9806-1ed48d640cfc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:22.171294 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f2b00391-a515-4d3c-9806-1ed48d640cfc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:22.370946 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-cce424a9-9cd0-4ebb-8cea-1d479d14f1bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:22.380172 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-cce424a9-9cd0-4ebb-8cea-1d479d14f1bf tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1565 microversion: 2.1 time: 0.256184 Sep 11 00:58:22.380454 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 180/349] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:22 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1565 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:22.385396 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-18eff2f7-79f2-40bb-a705-31dd8b0d77e6 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:22.385992 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-18eff2f7-79f2-40bb-a705-31dd8b0d77e6 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:22.392050 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-18eff2f7-79f2-40bb-a705-31dd8b0d77e6 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:22.392807 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-18eff2f7-79f2-40bb-a705-31dd8b0d77e6 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:22.393474 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-18eff2f7-79f2-40bb-a705-31dd8b0d77e6 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:22.394410 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-18eff2f7-79f2-40bb-a705-31dd8b0d77e6 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:22.395072 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-18eff2f7-79f2-40bb-a705-31dd8b0d77e6 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:22.395744 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-18eff2f7-79f2-40bb-a705-31dd8b0d77e6 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:22.411433 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f2b00391-a515-4d3c-9806-1ed48d640cfc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:22.421091 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f2b00391-a515-4d3c-9806-1ed48d640cfc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:22.423647 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f2b00391-a515-4d3c-9806-1ed48d640cfc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:22.425405 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f2b00391-a515-4d3c-9806-1ed48d640cfc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1722 microversion: 2.20 time: 0.272042 Sep 11 00:58:22.431586 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 170/350] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:22 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:58:22.441777 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-994673c7-a3c7-4198-85ad-7d7229e4c486 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:22.442828 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-994673c7-a3c7-4198-85ad-7d7229e4c486 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:22.453747 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-994673c7-a3c7-4198-85ad-7d7229e4c486 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:22.454351 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-994673c7-a3c7-4198-85ad-7d7229e4c486 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:22.454881 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-994673c7-a3c7-4198-85ad-7d7229e4c486 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:22.455676 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-994673c7-a3c7-4198-85ad-7d7229e4c486 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:22.456332 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-994673c7-a3c7-4198-85ad-7d7229e4c486 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:22.456972 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-994673c7-a3c7-4198-85ad-7d7229e4c486 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:22.570841 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-994673c7-a3c7-4198-85ad-7d7229e4c486 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137635 Sep 11 00:58:22.572175 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 171/351] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Sep 11 00:58:22 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:58:22.598235 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-18eff2f7-79f2-40bb-a705-31dd8b0d77e6 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:22.606078 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-18eff2f7-79f2-40bb-a705-31dd8b0d77e6 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1318 microversion: 2.1 time: 0.224677 Sep 11 00:58:22.606654 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 181/352] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:22 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:23.461596 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-da5659eb-f2c8-42c5-9096-1395d600370e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:23.462327 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-da5659eb-f2c8-42c5-9096-1395d600370e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:23.468821 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-da5659eb-f2c8-42c5-9096-1395d600370e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:23.469311 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-da5659eb-f2c8-42c5-9096-1395d600370e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:23.469743 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-da5659eb-f2c8-42c5-9096-1395d600370e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:23.470439 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-da5659eb-f2c8-42c5-9096-1395d600370e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:23.470888 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-da5659eb-f2c8-42c5-9096-1395d600370e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:23.471345 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-da5659eb-f2c8-42c5-9096-1395d600370e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:23.530908 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-a0b9fe9e-a7ee-42a2-ae66-fa77d18d84a0 req-001aec33-249d-4f40-9141-a5cd7091b19d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56cf74eb-5098-47e8-b99c-efd0af892b66", "tag": "5ae85da6-bc81-47ad-9baf-b2583a2b801b"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:23.540435 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-a0b9fe9e-a7ee-42a2-ae66-fa77d18d84a0 req-001aec33-249d-4f40-9141-a5cd7091b19d service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:23.540908 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-a0b9fe9e-a7ee-42a2-ae66-fa77d18d84a0 req-001aec33-249d-4f40-9141-a5cd7091b19d service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:23.541330 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-a0b9fe9e-a7ee-42a2-ae66-fa77d18d84a0 req-001aec33-249d-4f40-9141-a5cd7091b19d service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:23.553270 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-a0b9fe9e-a7ee-42a2-ae66-fa77d18d84a0 req-001aec33-249d-4f40-9141-a5cd7091b19d service nova] Creating event network-changed:5ae85da6-bc81-47ad-9baf-b2583a2b801b for instance 56cf74eb-5098-47e8-b99c-efd0af892b66 on hv-cinder-maste Sep 11 00:58:23.558443 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-a0b9fe9e-a7ee-42a2-ae66-fa77d18d84a0 req-001aec33-249d-4f40-9141-a5cd7091b19d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031180 Sep 11 00:58:23.559031 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 182/353] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:58:23.605222 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-da5659eb-f2c8-42c5-9096-1395d600370e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:23.613816 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-da5659eb-f2c8-42c5-9096-1395d600370e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:23.615273 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-da5659eb-f2c8-42c5-9096-1395d600370e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:23.616425 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-da5659eb-f2c8-42c5-9096-1395d600370e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1722 microversion: 2.20 time: 0.159302 Sep 11 00:58:23.616981 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 172/354] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:23 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:23.628302 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-57b9eec0-0252-4350-aa25-6d2ab7149a62 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:23.628990 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-57b9eec0-0252-4350-aa25-6d2ab7149a62 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:23.635260 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-57b9eec0-0252-4350-aa25-6d2ab7149a62 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:23.635679 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-57b9eec0-0252-4350-aa25-6d2ab7149a62 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:23.636697 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-57b9eec0-0252-4350-aa25-6d2ab7149a62 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:23.637389 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-57b9eec0-0252-4350-aa25-6d2ab7149a62 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:23.637831 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-57b9eec0-0252-4350-aa25-6d2ab7149a62 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:23.638244 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-57b9eec0-0252-4350-aa25-6d2ab7149a62 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:23.774159 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-57b9eec0-0252-4350-aa25-6d2ab7149a62 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:23.782356 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-57b9eec0-0252-4350-aa25-6d2ab7149a62 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1318 microversion: 2.1 time: 0.158203 Sep 11 00:58:23.782931 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 183/355] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:23 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:58:24.643075 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8b56080e-3e49-41a8-9ba6-4876c42b9571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:24.643709 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8b56080e-3e49-41a8-9ba6-4876c42b9571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:24.650753 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8b56080e-3e49-41a8-9ba6-4876c42b9571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:24.651260 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8b56080e-3e49-41a8-9ba6-4876c42b9571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:24.651711 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8b56080e-3e49-41a8-9ba6-4876c42b9571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:24.652413 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8b56080e-3e49-41a8-9ba6-4876c42b9571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:24.652834 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8b56080e-3e49-41a8-9ba6-4876c42b9571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:24.653266 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8b56080e-3e49-41a8-9ba6-4876c42b9571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:24.789741 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8b56080e-3e49-41a8-9ba6-4876c42b9571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:24.799222 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8b56080e-3e49-41a8-9ba6-4876c42b9571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:24.800694 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8b56080e-3e49-41a8-9ba6-4876c42b9571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:24.802123 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8b56080e-3e49-41a8-9ba6-4876c42b9571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1722 microversion: 2.20 time: 0.163799 Sep 11 00:58:24.802769 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 173/356] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:24 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:24.805107 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-2432e82b-ed0d-44eb-94fd-d62039b6f270 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:24.805762 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-2432e82b-ed0d-44eb-94fd-d62039b6f270 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:24.812803 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2432e82b-ed0d-44eb-94fd-d62039b6f270 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:24.813291 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2432e82b-ed0d-44eb-94fd-d62039b6f270 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:24.813733 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2432e82b-ed0d-44eb-94fd-d62039b6f270 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:24.814428 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2432e82b-ed0d-44eb-94fd-d62039b6f270 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:24.814874 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2432e82b-ed0d-44eb-94fd-d62039b6f270 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:24.815320 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2432e82b-ed0d-44eb-94fd-d62039b6f270 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:24.935514 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-c74dcd5c-dde3-4d78-adc9-0ce8a36530b8 req-e478d94a-43bc-44d1-8cd9-0dcf31b8de60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185afbdf-74f7-4a54-8ba8-58e7b6fd2e73", "name": "network-vif-unplugged", "status": "completed", "tag": "903eede7-b91a-4899-9cea-f0ba8d7eea74"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:24.945460 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c74dcd5c-dde3-4d78-adc9-0ce8a36530b8 req-e478d94a-43bc-44d1-8cd9-0dcf31b8de60 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:24.946078 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c74dcd5c-dde3-4d78-adc9-0ce8a36530b8 req-e478d94a-43bc-44d1-8cd9-0dcf31b8de60 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:24.946696 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c74dcd5c-dde3-4d78-adc9-0ce8a36530b8 req-e478d94a-43bc-44d1-8cd9-0dcf31b8de60 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:24.961030 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-c74dcd5c-dde3-4d78-adc9-0ce8a36530b8 req-e478d94a-43bc-44d1-8cd9-0dcf31b8de60 service nova] Creating event network-vif-unplugged:903eede7-b91a-4899-9cea-f0ba8d7eea74 for instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 on hv-cinder-maste Sep 11 00:58:24.967160 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-c74dcd5c-dde3-4d78-adc9-0ce8a36530b8 req-e478d94a-43bc-44d1-8cd9-0dcf31b8de60 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035275 Sep 11 00:58:24.968389 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 174/357] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:58:24.982770 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-2432e82b-ed0d-44eb-94fd-d62039b6f270 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:24.991021 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-2432e82b-ed0d-44eb-94fd-d62039b6f270 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1318 microversion: 2.1 time: 0.189773 Sep 11 00:58:24.991845 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 184/358] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:24 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:58:25.834656 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b7faf24f-9f4d-4088-b7c9-268797afec33 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:25.835726 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b7faf24f-9f4d-4088-b7c9-268797afec33 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:25.843052 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b7faf24f-9f4d-4088-b7c9-268797afec33 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:25.843570 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b7faf24f-9f4d-4088-b7c9-268797afec33 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:25.844002 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b7faf24f-9f4d-4088-b7c9-268797afec33 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:25.844687 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b7faf24f-9f4d-4088-b7c9-268797afec33 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:25.845136 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b7faf24f-9f4d-4088-b7c9-268797afec33 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:25.845555 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b7faf24f-9f4d-4088-b7c9-268797afec33 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:25.976584 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b7faf24f-9f4d-4088-b7c9-268797afec33 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:25.985433 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b7faf24f-9f4d-4088-b7c9-268797afec33 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:25.986846 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b7faf24f-9f4d-4088-b7c9-268797afec33 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:25.988019 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b7faf24f-9f4d-4088-b7c9-268797afec33 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1725 microversion: 2.20 time: 0.160798 Sep 11 00:58:25.988576 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 175/359] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:25 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:26.012992 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-efd48e0c-53fb-45e9-94f1-de6a5e75d935 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fe6fae6-1726-4f33-9351-8466fa5ec1a8"}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:26.013531 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f5c45d8a-094d-4ebd-8997-b8b1976a28a7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:26.014010 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f5c45d8a-094d-4ebd-8997-b8b1976a28a7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:26.015331 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-efd48e0c-53fb-45e9-94f1-de6a5e75d935 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:26.020273 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f5c45d8a-094d-4ebd-8997-b8b1976a28a7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:26.020754 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f5c45d8a-094d-4ebd-8997-b8b1976a28a7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:26.021181 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f5c45d8a-094d-4ebd-8997-b8b1976a28a7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:26.021568 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-efd48e0c-53fb-45e9-94f1-de6a5e75d935 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:26.021867 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f5c45d8a-094d-4ebd-8997-b8b1976a28a7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:26.022320 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f5c45d8a-094d-4ebd-8997-b8b1976a28a7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:26.022416 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-efd48e0c-53fb-45e9-94f1-de6a5e75d935 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:26.022730 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f5c45d8a-094d-4ebd-8997-b8b1976a28a7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:26.022826 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-efd48e0c-53fb-45e9-94f1-de6a5e75d935 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:26.023507 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-efd48e0c-53fb-45e9-94f1-de6a5e75d935 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:26.024071 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-efd48e0c-53fb-45e9-94f1-de6a5e75d935 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:26.024527 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-efd48e0c-53fb-45e9-94f1-de6a5e75d935 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:26.152768 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f5c45d8a-094d-4ebd-8997-b8b1976a28a7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:26.161280 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f5c45d8a-094d-4ebd-8997-b8b1976a28a7 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1318 microversion: 2.1 time: 0.151102 Sep 11 00:58:26.161763 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 176/360] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:26 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:26.351008 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-efd48e0c-53fb-45e9-94f1-de6a5e75d935 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "POST /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.342587 Sep 11 00:58:26.357475 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 185/361] 10.222.0.23 () {62 vars in 1364 bytes} [Sun Sep 11 00:58:26 2022] POST /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments => generated 188 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:58:26.484306 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5b270c38-fe29-4763-a416-6133fe21f571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:26.484917 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5b270c38-fe29-4763-a416-6133fe21f571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:26.493309 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5b270c38-fe29-4763-a416-6133fe21f571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:26.494105 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5b270c38-fe29-4763-a416-6133fe21f571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:26.494549 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5b270c38-fe29-4763-a416-6133fe21f571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:26.495365 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5b270c38-fe29-4763-a416-6133fe21f571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:26.495962 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5b270c38-fe29-4763-a416-6133fe21f571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:26.496328 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5b270c38-fe29-4763-a416-6133fe21f571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:26.539678 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5b270c38-fe29-4763-a416-6133fe21f571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120496) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 00:58:26.608939 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5b270c38-fe29-4763-a416-6133fe21f571 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "POST /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/action" status: 202 len: 0 microversion: 2.20 time: 0.129115 Sep 11 00:58:26.609858 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 177/362] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Sep 11 00:58:26 2022] POST /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:58:26.618203 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d08a5264-b09d-4fe2-af9f-55c2f084fbc4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:26.619374 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d08a5264-b09d-4fe2-af9f-55c2f084fbc4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:26.625392 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d08a5264-b09d-4fe2-af9f-55c2f084fbc4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:26.625957 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d08a5264-b09d-4fe2-af9f-55c2f084fbc4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:26.626398 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d08a5264-b09d-4fe2-af9f-55c2f084fbc4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:26.627251 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d08a5264-b09d-4fe2-af9f-55c2f084fbc4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:26.627576 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d08a5264-b09d-4fe2-af9f-55c2f084fbc4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:26.628003 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d08a5264-b09d-4fe2-af9f-55c2f084fbc4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:26.763644 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d08a5264-b09d-4fe2-af9f-55c2f084fbc4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:26.766131 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:26.774904 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d08a5264-b09d-4fe2-af9f-55c2f084fbc4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:26.776493 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d08a5264-b09d-4fe2-af9f-55c2f084fbc4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:26.777728 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d08a5264-b09d-4fe2-af9f-55c2f084fbc4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1811 microversion: 2.20 time: 0.163646 Sep 11 00:58:26.778606 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 186/363] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:26 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:58:27.186661 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d8f44151-3510-4e71-bfe4-d0c12cdb2bfe tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:27.187811 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d8f44151-3510-4e71-bfe4-d0c12cdb2bfe tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:27.197124 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d8f44151-3510-4e71-bfe4-d0c12cdb2bfe tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:27.197864 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d8f44151-3510-4e71-bfe4-d0c12cdb2bfe tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:27.198529 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d8f44151-3510-4e71-bfe4-d0c12cdb2bfe tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:27.199600 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d8f44151-3510-4e71-bfe4-d0c12cdb2bfe tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:27.200282 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d8f44151-3510-4e71-bfe4-d0c12cdb2bfe tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:27.200909 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d8f44151-3510-4e71-bfe4-d0c12cdb2bfe tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:27.348264 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-d8f44151-3510-4e71-bfe4-d0c12cdb2bfe tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:27.356728 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d8f44151-3510-4e71-bfe4-d0c12cdb2bfe tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1507 microversion: 2.1 time: 0.176152 Sep 11 00:58:27.357320 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 178/364] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:27 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:58:27.813336 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-9ae355fa-abda-4c97-ae4e-2de5dde6c5cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:27.814024 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-9ae355fa-abda-4c97-ae4e-2de5dde6c5cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:27.822124 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9ae355fa-abda-4c97-ae4e-2de5dde6c5cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:27.822719 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9ae355fa-abda-4c97-ae4e-2de5dde6c5cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:27.823326 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9ae355fa-abda-4c97-ae4e-2de5dde6c5cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:27.824223 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9ae355fa-abda-4c97-ae4e-2de5dde6c5cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:27.824668 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9ae355fa-abda-4c97-ae4e-2de5dde6c5cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:27.825335 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9ae355fa-abda-4c97-ae4e-2de5dde6c5cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:27.961837 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-9ae355fa-abda-4c97-ae4e-2de5dde6c5cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:27.971098 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-9ae355fa-abda-4c97-ae4e-2de5dde6c5cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:27.972611 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-9ae355fa-abda-4c97-ae4e-2de5dde6c5cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:27.973819 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-9ae355fa-abda-4c97-ae4e-2de5dde6c5cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1751 microversion: 2.20 time: 0.165102 Sep 11 00:58:27.974343 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 187/365] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:27 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 00:58:29.001081 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f6649a3d-5ceb-481a-a32b-6237946e3bcc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:29.001677 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f6649a3d-5ceb-481a-a32b-6237946e3bcc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:29.008560 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f6649a3d-5ceb-481a-a32b-6237946e3bcc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:29.009049 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f6649a3d-5ceb-481a-a32b-6237946e3bcc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:29.010292 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f6649a3d-5ceb-481a-a32b-6237946e3bcc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:29.010987 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f6649a3d-5ceb-481a-a32b-6237946e3bcc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:29.011471 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f6649a3d-5ceb-481a-a32b-6237946e3bcc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:29.011892 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f6649a3d-5ceb-481a-a32b-6237946e3bcc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:29.148651 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f6649a3d-5ceb-481a-a32b-6237946e3bcc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:29.162050 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f6649a3d-5ceb-481a-a32b-6237946e3bcc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:29.163495 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f6649a3d-5ceb-481a-a32b-6237946e3bcc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:29.165352 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f6649a3d-5ceb-481a-a32b-6237946e3bcc tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.167780 Sep 11 00:58:29.165942 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 179/366] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:28 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:30.192139 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0f74ebb1-2b8a-4efa-80d8-168fceb252ef tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:30.193103 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-0f74ebb1-2b8a-4efa-80d8-168fceb252ef tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:30.200220 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0f74ebb1-2b8a-4efa-80d8-168fceb252ef tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:30.200790 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0f74ebb1-2b8a-4efa-80d8-168fceb252ef tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:30.201286 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0f74ebb1-2b8a-4efa-80d8-168fceb252ef tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:30.202242 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0f74ebb1-2b8a-4efa-80d8-168fceb252ef tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:30.202951 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0f74ebb1-2b8a-4efa-80d8-168fceb252ef tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:30.203730 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0f74ebb1-2b8a-4efa-80d8-168fceb252ef tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:30.343484 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0f74ebb1-2b8a-4efa-80d8-168fceb252ef tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:30.353662 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0f74ebb1-2b8a-4efa-80d8-168fceb252ef tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:30.355197 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0f74ebb1-2b8a-4efa-80d8-168fceb252ef tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:30.356480 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0f74ebb1-2b8a-4efa-80d8-168fceb252ef tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.169667 Sep 11 00:58:30.357031 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 188/367] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:30 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:31.385269 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1fe0b3fd-604a-46e0-96cd-8493712782ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:31.385269 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1fe0b3fd-604a-46e0-96cd-8493712782ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:31.391188 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1fe0b3fd-604a-46e0-96cd-8493712782ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:31.391700 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1fe0b3fd-604a-46e0-96cd-8493712782ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:31.392146 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1fe0b3fd-604a-46e0-96cd-8493712782ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:31.392849 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1fe0b3fd-604a-46e0-96cd-8493712782ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:31.393304 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1fe0b3fd-604a-46e0-96cd-8493712782ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:31.393730 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1fe0b3fd-604a-46e0-96cd-8493712782ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:31.539380 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1fe0b3fd-604a-46e0-96cd-8493712782ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:31.549357 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1fe0b3fd-604a-46e0-96cd-8493712782ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:31.550899 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1fe0b3fd-604a-46e0-96cd-8493712782ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:31.552195 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1fe0b3fd-604a-46e0-96cd-8493712782ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.173701 Sep 11 00:58:31.552754 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 180/368] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:31 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:32.577619 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-666b4e7d-5198-4ea6-a83c-254ead337ee7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:32.578914 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-666b4e7d-5198-4ea6-a83c-254ead337ee7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:32.586317 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-666b4e7d-5198-4ea6-a83c-254ead337ee7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:32.587568 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-666b4e7d-5198-4ea6-a83c-254ead337ee7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:32.588044 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-666b4e7d-5198-4ea6-a83c-254ead337ee7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:32.588808 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-666b4e7d-5198-4ea6-a83c-254ead337ee7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:32.589260 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-666b4e7d-5198-4ea6-a83c-254ead337ee7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:32.589680 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-666b4e7d-5198-4ea6-a83c-254ead337ee7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:32.731233 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-666b4e7d-5198-4ea6-a83c-254ead337ee7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:32.743021 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-666b4e7d-5198-4ea6-a83c-254ead337ee7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:32.744548 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-666b4e7d-5198-4ea6-a83c-254ead337ee7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:32.745769 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-666b4e7d-5198-4ea6-a83c-254ead337ee7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.172121 Sep 11 00:58:32.746524 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 189/369] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:32 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:33.771435 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-876e9364-14c9-48bc-aa6b-09e15e3e31d2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:33.772023 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-876e9364-14c9-48bc-aa6b-09e15e3e31d2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:33.778938 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-876e9364-14c9-48bc-aa6b-09e15e3e31d2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:33.779459 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-876e9364-14c9-48bc-aa6b-09e15e3e31d2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:33.779889 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-876e9364-14c9-48bc-aa6b-09e15e3e31d2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:33.780630 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-876e9364-14c9-48bc-aa6b-09e15e3e31d2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:33.781092 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-876e9364-14c9-48bc-aa6b-09e15e3e31d2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:33.781512 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-876e9364-14c9-48bc-aa6b-09e15e3e31d2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:33.925926 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-876e9364-14c9-48bc-aa6b-09e15e3e31d2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:33.937176 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-876e9364-14c9-48bc-aa6b-09e15e3e31d2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:33.938609 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-876e9364-14c9-48bc-aa6b-09e15e3e31d2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:33.939800 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-876e9364-14c9-48bc-aa6b-09e15e3e31d2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.172596 Sep 11 00:58:33.940366 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 181/370] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:33 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:34.967341 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f6b369fc-6b91-4e4a-ab44-cf4a1a9bcefd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:34.967954 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f6b369fc-6b91-4e4a-ab44-cf4a1a9bcefd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:34.974439 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f6b369fc-6b91-4e4a-ab44-cf4a1a9bcefd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:34.974916 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f6b369fc-6b91-4e4a-ab44-cf4a1a9bcefd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:34.975390 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f6b369fc-6b91-4e4a-ab44-cf4a1a9bcefd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:34.976080 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f6b369fc-6b91-4e4a-ab44-cf4a1a9bcefd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:34.976519 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f6b369fc-6b91-4e4a-ab44-cf4a1a9bcefd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:34.976910 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f6b369fc-6b91-4e4a-ab44-cf4a1a9bcefd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:35.146616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f6b369fc-6b91-4e4a-ab44-cf4a1a9bcefd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:35.157539 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f6b369fc-6b91-4e4a-ab44-cf4a1a9bcefd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:35.164005 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f6b369fc-6b91-4e4a-ab44-cf4a1a9bcefd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:35.165308 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f6b369fc-6b91-4e4a-ab44-cf4a1a9bcefd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.203590 Sep 11 00:58:35.166304 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 190/371] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:34 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:36.191151 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a8638836-6ded-41aa-9079-c16fd355b7fd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:36.191902 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a8638836-6ded-41aa-9079-c16fd355b7fd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:36.198642 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a8638836-6ded-41aa-9079-c16fd355b7fd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:36.199133 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a8638836-6ded-41aa-9079-c16fd355b7fd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:36.199574 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a8638836-6ded-41aa-9079-c16fd355b7fd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:36.200257 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a8638836-6ded-41aa-9079-c16fd355b7fd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:36.200695 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a8638836-6ded-41aa-9079-c16fd355b7fd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:36.201110 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a8638836-6ded-41aa-9079-c16fd355b7fd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:36.360145 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a8638836-6ded-41aa-9079-c16fd355b7fd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:36.362546 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:36.370791 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a8638836-6ded-41aa-9079-c16fd355b7fd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:36.372424 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a8638836-6ded-41aa-9079-c16fd355b7fd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:36.373700 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a8638836-6ded-41aa-9079-c16fd355b7fd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.186487 Sep 11 00:58:36.374277 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 182/372] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:36 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:37.402092 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f38f2f31-58a1-4d12-bb28-ba182088abe7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:37.402697 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f38f2f31-58a1-4d12-bb28-ba182088abe7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:37.409473 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f38f2f31-58a1-4d12-bb28-ba182088abe7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:37.409944 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f38f2f31-58a1-4d12-bb28-ba182088abe7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:37.410430 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f38f2f31-58a1-4d12-bb28-ba182088abe7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:37.411218 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f38f2f31-58a1-4d12-bb28-ba182088abe7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:37.411601 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f38f2f31-58a1-4d12-bb28-ba182088abe7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:37.412019 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f38f2f31-58a1-4d12-bb28-ba182088abe7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:37.828545 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f38f2f31-58a1-4d12-bb28-ba182088abe7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:37.842288 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f38f2f31-58a1-4d12-bb28-ba182088abe7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:37.868629 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f38f2f31-58a1-4d12-bb28-ba182088abe7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:37.868629 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f38f2f31-58a1-4d12-bb28-ba182088abe7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.447018 Sep 11 00:58:37.868629 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 191/373] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:37 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:38.871291 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8e227fe2-0864-4e58-8a67-d0a07d5a276e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:38.872151 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8e227fe2-0864-4e58-8a67-d0a07d5a276e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:38.881188 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e227fe2-0864-4e58-8a67-d0a07d5a276e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:38.881673 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e227fe2-0864-4e58-8a67-d0a07d5a276e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:38.882106 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e227fe2-0864-4e58-8a67-d0a07d5a276e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:38.882996 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e227fe2-0864-4e58-8a67-d0a07d5a276e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:38.883472 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e227fe2-0864-4e58-8a67-d0a07d5a276e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:38.883891 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e227fe2-0864-4e58-8a67-d0a07d5a276e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:39.026886 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8e227fe2-0864-4e58-8a67-d0a07d5a276e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:39.036489 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8e227fe2-0864-4e58-8a67-d0a07d5a276e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:39.037898 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8e227fe2-0864-4e58-8a67-d0a07d5a276e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:39.039068 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8e227fe2-0864-4e58-8a67-d0a07d5a276e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.172246 Sep 11 00:58:39.039660 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 183/374] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:38 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:40.066507 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-1584af0a-8a7e-49c0-bee5-c1547972053c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:40.067406 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-1584af0a-8a7e-49c0-bee5-c1547972053c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:40.074312 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1584af0a-8a7e-49c0-bee5-c1547972053c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:40.074789 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1584af0a-8a7e-49c0-bee5-c1547972053c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:40.075217 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1584af0a-8a7e-49c0-bee5-c1547972053c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:40.075939 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1584af0a-8a7e-49c0-bee5-c1547972053c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:40.076382 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1584af0a-8a7e-49c0-bee5-c1547972053c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:40.076773 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1584af0a-8a7e-49c0-bee5-c1547972053c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:40.237331 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1584af0a-8a7e-49c0-bee5-c1547972053c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:40.246560 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1584af0a-8a7e-49c0-bee5-c1547972053c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:40.248046 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1584af0a-8a7e-49c0-bee5-c1547972053c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:40.249216 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-1584af0a-8a7e-49c0-bee5-c1547972053c tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.186745 Sep 11 00:58:40.250027 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 192/375] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:40 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:41.277147 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a0dcef6c-5622-430f-b2af-1650894cc093 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:41.278017 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a0dcef6c-5622-430f-b2af-1650894cc093 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:41.284658 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0dcef6c-5622-430f-b2af-1650894cc093 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:41.285137 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0dcef6c-5622-430f-b2af-1650894cc093 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:41.285564 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0dcef6c-5622-430f-b2af-1650894cc093 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:41.286256 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0dcef6c-5622-430f-b2af-1650894cc093 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:41.286710 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0dcef6c-5622-430f-b2af-1650894cc093 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:41.287144 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0dcef6c-5622-430f-b2af-1650894cc093 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:41.421195 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a0dcef6c-5622-430f-b2af-1650894cc093 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:41.431717 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a0dcef6c-5622-430f-b2af-1650894cc093 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:41.433173 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a0dcef6c-5622-430f-b2af-1650894cc093 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:41.434330 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a0dcef6c-5622-430f-b2af-1650894cc093 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.161394 Sep 11 00:58:41.434892 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 184/376] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:41 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:42.464258 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ac188c98-3629-457f-a041-82ae89d9c847 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:42.465662 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ac188c98-3629-457f-a041-82ae89d9c847 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:42.477044 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac188c98-3629-457f-a041-82ae89d9c847 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:42.477841 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac188c98-3629-457f-a041-82ae89d9c847 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:42.478544 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac188c98-3629-457f-a041-82ae89d9c847 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:42.479714 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac188c98-3629-457f-a041-82ae89d9c847 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:42.480449 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac188c98-3629-457f-a041-82ae89d9c847 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:42.481141 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac188c98-3629-457f-a041-82ae89d9c847 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:42.620911 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ac188c98-3629-457f-a041-82ae89d9c847 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:42.629722 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ac188c98-3629-457f-a041-82ae89d9c847 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:42.631153 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ac188c98-3629-457f-a041-82ae89d9c847 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:42.632329 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ac188c98-3629-457f-a041-82ae89d9c847 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.175158 Sep 11 00:58:42.632927 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 193/377] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:42 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:43.658098 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e005f324-9e6f-46dc-8f01-89b67c87351f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:43.658712 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e005f324-9e6f-46dc-8f01-89b67c87351f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:43.666133 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e005f324-9e6f-46dc-8f01-89b67c87351f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:43.666622 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e005f324-9e6f-46dc-8f01-89b67c87351f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:43.667670 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e005f324-9e6f-46dc-8f01-89b67c87351f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:43.668443 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e005f324-9e6f-46dc-8f01-89b67c87351f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:43.670601 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e005f324-9e6f-46dc-8f01-89b67c87351f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:43.671043 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e005f324-9e6f-46dc-8f01-89b67c87351f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:43.798973 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e005f324-9e6f-46dc-8f01-89b67c87351f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:43.808240 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e005f324-9e6f-46dc-8f01-89b67c87351f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:43.809707 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e005f324-9e6f-46dc-8f01-89b67c87351f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:43.810886 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e005f324-9e6f-46dc-8f01-89b67c87351f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.157138 Sep 11 00:58:43.811496 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 185/378] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:43 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:44.838977 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-2a23b678-1e34-4c2d-9067-84e51f2695e9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:44.839816 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-2a23b678-1e34-4c2d-9067-84e51f2695e9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:44.842967 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=50 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:44.850586 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2a23b678-1e34-4c2d-9067-84e51f2695e9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:44.851050 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2a23b678-1e34-4c2d-9067-84e51f2695e9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:44.851509 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2a23b678-1e34-4c2d-9067-84e51f2695e9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:44.852184 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2a23b678-1e34-4c2d-9067-84e51f2695e9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:44.852631 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2a23b678-1e34-4c2d-9067-84e51f2695e9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:44.853049 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2a23b678-1e34-4c2d-9067-84e51f2695e9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:44.987305 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-2a23b678-1e34-4c2d-9067-84e51f2695e9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:44.996222 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-2a23b678-1e34-4c2d-9067-84e51f2695e9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:44.997671 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-2a23b678-1e34-4c2d-9067-84e51f2695e9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:44.998904 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-2a23b678-1e34-4c2d-9067-84e51f2695e9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.165534 Sep 11 00:58:44.999466 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 194/379] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:44 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:45.842671 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-02c57b70-1f7e-42e7-bc85-aa77cc3c94c4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f03c1f40-8136-4843-9584-ed4fefc5ee0f", "device": "/dev/sdb"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:45.845614 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-02c57b70-1f7e-42e7-bc85-aa77cc3c94c4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:45.852402 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-02c57b70-1f7e-42e7-bc85-aa77cc3c94c4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:45.852895 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-02c57b70-1f7e-42e7-bc85-aa77cc3c94c4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:45.853323 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-02c57b70-1f7e-42e7-bc85-aa77cc3c94c4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:45.854004 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-02c57b70-1f7e-42e7-bc85-aa77cc3c94c4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:45.854463 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-02c57b70-1f7e-42e7-bc85-aa77cc3c94c4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:45.854854 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-02c57b70-1f7e-42e7-bc85-aa77cc3c94c4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:46.023855 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-4c755ba3-324f-44eb-af0a-4b490b769149 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:46.024457 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-4c755ba3-324f-44eb-af0a-4b490b769149 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:46.031007 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4c755ba3-324f-44eb-af0a-4b490b769149 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:46.031527 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4c755ba3-324f-44eb-af0a-4b490b769149 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:46.031960 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4c755ba3-324f-44eb-af0a-4b490b769149 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:46.032653 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4c755ba3-324f-44eb-af0a-4b490b769149 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:46.033102 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4c755ba3-324f-44eb-af0a-4b490b769149 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:46.033523 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4c755ba3-324f-44eb-af0a-4b490b769149 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:46.163438 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-02c57b70-1f7e-42e7-bc85-aa77cc3c94c4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "POST /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324447 Sep 11 00:58:46.164062 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 186/380] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Sep 11 00:58:45 2022] POST /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:58:46.178635 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-4c755ba3-324f-44eb-af0a-4b490b769149 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:46.190888 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-4c755ba3-324f-44eb-af0a-4b490b769149 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:46.192912 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-4c755ba3-324f-44eb-af0a-4b490b769149 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:46.194441 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-4c755ba3-324f-44eb-af0a-4b490b769149 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.174578 Sep 11 00:58:46.195499 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 195/381] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:46 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:47.223115 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8188c269-4774-40c3-b682-8510486ac7c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:47.224019 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8188c269-4774-40c3-b682-8510486ac7c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:47.231035 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8188c269-4774-40c3-b682-8510486ac7c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:47.231545 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8188c269-4774-40c3-b682-8510486ac7c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:47.231980 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8188c269-4774-40c3-b682-8510486ac7c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:47.232673 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8188c269-4774-40c3-b682-8510486ac7c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:47.233123 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8188c269-4774-40c3-b682-8510486ac7c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:47.233548 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8188c269-4774-40c3-b682-8510486ac7c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:47.373613 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8188c269-4774-40c3-b682-8510486ac7c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:47.382581 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8188c269-4774-40c3-b682-8510486ac7c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:47.384071 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8188c269-4774-40c3-b682-8510486ac7c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:47.385262 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8188c269-4774-40c3-b682-8510486ac7c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.168161 Sep 11 00:58:47.385816 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 187/382] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:47 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:48.410546 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-71c410d4-a3c5-4c3e-a253-5e27c9e48e6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:48.411449 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-71c410d4-a3c5-4c3e-a253-5e27c9e48e6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:48.418579 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-71c410d4-a3c5-4c3e-a253-5e27c9e48e6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:48.419103 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-71c410d4-a3c5-4c3e-a253-5e27c9e48e6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:48.419566 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-71c410d4-a3c5-4c3e-a253-5e27c9e48e6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:48.420297 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-71c410d4-a3c5-4c3e-a253-5e27c9e48e6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:48.420745 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-71c410d4-a3c5-4c3e-a253-5e27c9e48e6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:48.421166 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-71c410d4-a3c5-4c3e-a253-5e27c9e48e6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:48.561913 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-71c410d4-a3c5-4c3e-a253-5e27c9e48e6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:48.573915 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-71c410d4-a3c5-4c3e-a253-5e27c9e48e6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:48.575764 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-71c410d4-a3c5-4c3e-a253-5e27c9e48e6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:48.577391 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-71c410d4-a3c5-4c3e-a253-5e27c9e48e6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.171186 Sep 11 00:58:48.578412 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 196/383] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:48 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:49.104335 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-6a26a7cc-c8dc-42b3-908e-43d5b9d406fb req-b0f522cb-4d95-4420-b079-01f90588f84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185afbdf-74f7-4a54-8ba8-58e7b6fd2e73", "name": "network-vif-plugged", "status": "completed", "tag": "903eede7-b91a-4899-9cea-f0ba8d7eea74"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:49.120513 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-6a26a7cc-c8dc-42b3-908e-43d5b9d406fb req-b0f522cb-4d95-4420-b079-01f90588f84e service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:49.120992 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-6a26a7cc-c8dc-42b3-908e-43d5b9d406fb req-b0f522cb-4d95-4420-b079-01f90588f84e service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:49.121410 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-6a26a7cc-c8dc-42b3-908e-43d5b9d406fb req-b0f522cb-4d95-4420-b079-01f90588f84e service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:49.132948 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-6a26a7cc-c8dc-42b3-908e-43d5b9d406fb req-b0f522cb-4d95-4420-b079-01f90588f84e service nova] Creating event network-vif-plugged:903eede7-b91a-4899-9cea-f0ba8d7eea74 for instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 on hv-cinder-maste Sep 11 00:58:49.138670 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-6a26a7cc-c8dc-42b3-908e-43d5b9d406fb req-b0f522cb-4d95-4420-b079-01f90588f84e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038320 Sep 11 00:58:49.145284 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 188/384] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:58:49.243418 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-9ecf3813-c4ee-44b5-98ab-16a947d43fd3 req-f9393fa5-ff01-44af-af91-40f706e33fc0 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "f03c1f40-8136-4843-9584-ed4fefc5ee0f", "create_info": {"type": "qcow2", "new_file": "volume-f03c1f40-8136-4843-9584-ed4fefc5ee0f.2978f88a-35b1-4fbf-a20e-8ccf5a907f53.vhdx", "snapshot_id": "2978f88a-35b1-4fbf-a20e-8ccf5a907f53"}}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:49.253035 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [req-9ecf3813-c4ee-44b5-98ab-16a947d43fd3 req-f9393fa5-ff01-44af-af91-40f706e33fc0 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8719ce5-7462-4db4-8ae0-e38f988a1e8a(cell1) {{(pid=120497) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 11 00:58:49.253489 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-9ecf3813-c4ee-44b5-98ab-16a947d43fd3 req-f9393fa5-ff01-44af-af91-40f706e33fc0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:49.253931 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-9ecf3813-c4ee-44b5-98ab-16a947d43fd3 req-f9393fa5-ff01-44af-af91-40f706e33fc0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:49.254385 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-9ecf3813-c4ee-44b5-98ab-16a947d43fd3 req-f9393fa5-ff01-44af-af91-40f706e33fc0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:49.293507 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-9ecf3813-c4ee-44b5-98ab-16a947d43fd3 req-f9393fa5-ff01-44af-af91-40f706e33fc0 admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:49.293983 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-9ecf3813-c4ee-44b5-98ab-16a947d43fd3 req-f9393fa5-ff01-44af-af91-40f706e33fc0 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:49.294407 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-9ecf3813-c4ee-44b5-98ab-16a947d43fd3 req-f9393fa5-ff01-44af-af91-40f706e33fc0 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:49.317063 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-9ecf3813-c4ee-44b5-98ab-16a947d43fd3 req-f9393fa5-ff01-44af-af91-40f706e33fc0 admin admin] 10.222.0.46 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.129414 Sep 11 00:58:49.317669 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 197/385] 10.222.0.46 () {64 vars in 1326 bytes} [Sun Sep 11 00:58:49 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 11 00:58:49.608132 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-67594215-5550-4bbc-8daf-d081261c63e7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:49.609272 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-67594215-5550-4bbc-8daf-d081261c63e7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:49.619768 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-67594215-5550-4bbc-8daf-d081261c63e7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:49.620264 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-67594215-5550-4bbc-8daf-d081261c63e7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:49.620705 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-67594215-5550-4bbc-8daf-d081261c63e7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:49.621443 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-67594215-5550-4bbc-8daf-d081261c63e7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:49.621932 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-67594215-5550-4bbc-8daf-d081261c63e7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:49.622359 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-67594215-5550-4bbc-8daf-d081261c63e7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:49.765601 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-67594215-5550-4bbc-8daf-d081261c63e7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:49.778367 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-67594215-5550-4bbc-8daf-d081261c63e7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:49.780584 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-67594215-5550-4bbc-8daf-d081261c63e7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:49.782153 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-67594215-5550-4bbc-8daf-d081261c63e7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.181140 Sep 11 00:58:49.783065 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 189/386] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:49 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:50.817990 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5efacfea-278c-4469-88cb-c4136d765a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:50.818806 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-5efacfea-278c-4469-88cb-c4136d765a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:50.826730 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5efacfea-278c-4469-88cb-c4136d765a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:50.827222 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5efacfea-278c-4469-88cb-c4136d765a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:50.827679 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5efacfea-278c-4469-88cb-c4136d765a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:50.828369 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5efacfea-278c-4469-88cb-c4136d765a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:50.828820 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5efacfea-278c-4469-88cb-c4136d765a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:50.829248 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5efacfea-278c-4469-88cb-c4136d765a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:50.976227 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-5efacfea-278c-4469-88cb-c4136d765a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:50.985780 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-5efacfea-278c-4469-88cb-c4136d765a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:50.987297 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-5efacfea-278c-4469-88cb-c4136d765a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:50.988453 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-5efacfea-278c-4469-88cb-c4136d765a9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.178690 Sep 11 00:58:50.988998 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 198/387] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:50 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:52.014660 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6b19b8ac-67c2-42f9-9d91-41c77324c70f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:52.023983 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6b19b8ac-67c2-42f9-9d91-41c77324c70f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:52.023983 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:52.030856 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6b19b8ac-67c2-42f9-9d91-41c77324c70f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:52.031492 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6b19b8ac-67c2-42f9-9d91-41c77324c70f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:52.032085 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6b19b8ac-67c2-42f9-9d91-41c77324c70f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:52.033185 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6b19b8ac-67c2-42f9-9d91-41c77324c70f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:52.033881 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6b19b8ac-67c2-42f9-9d91-41c77324c70f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:52.034411 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6b19b8ac-67c2-42f9-9d91-41c77324c70f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:52.173819 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6b19b8ac-67c2-42f9-9d91-41c77324c70f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:52.182837 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6b19b8ac-67c2-42f9-9d91-41c77324c70f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:52.184309 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6b19b8ac-67c2-42f9-9d91-41c77324c70f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:52.185454 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6b19b8ac-67c2-42f9-9d91-41c77324c70f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.175697 Sep 11 00:58:52.186017 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 190/388] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:52 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:53.209992 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-511a3865-d60b-4571-96eb-be0cc4b972b4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:53.210589 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-511a3865-d60b-4571-96eb-be0cc4b972b4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:53.217448 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-511a3865-d60b-4571-96eb-be0cc4b972b4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:53.218157 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-511a3865-d60b-4571-96eb-be0cc4b972b4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:53.218718 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-511a3865-d60b-4571-96eb-be0cc4b972b4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:53.219443 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-511a3865-d60b-4571-96eb-be0cc4b972b4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:53.219893 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-511a3865-d60b-4571-96eb-be0cc4b972b4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:53.220309 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-511a3865-d60b-4571-96eb-be0cc4b972b4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:53.247435 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-9fea61b5-f2a6-4eec-bdb7-1863fe366b26 req-9ebbe098-f59e-4e9e-ad62-051a49380b1a admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "f03c1f40-8136-4843-9584-ed4fefc5ee0f", "create_info": {"type": "qcow2", "new_file": "volume-f03c1f40-8136-4843-9584-ed4fefc5ee0f.1d72130e-33aa-4dd7-b8c8-c5fdf0bed0f4.vhdx", "snapshot_id": "1d72130e-33aa-4dd7-b8c8-c5fdf0bed0f4"}}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:53.250786 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-9fea61b5-f2a6-4eec-bdb7-1863fe366b26 req-9ebbe098-f59e-4e9e-ad62-051a49380b1a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:53.251287 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-9fea61b5-f2a6-4eec-bdb7-1863fe366b26 req-9ebbe098-f59e-4e9e-ad62-051a49380b1a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:53.251735 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-9fea61b5-f2a6-4eec-bdb7-1863fe366b26 req-9ebbe098-f59e-4e9e-ad62-051a49380b1a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:53.260119 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-9fea61b5-f2a6-4eec-bdb7-1863fe366b26 req-9ebbe098-f59e-4e9e-ad62-051a49380b1a admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:53.260591 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-9fea61b5-f2a6-4eec-bdb7-1863fe366b26 req-9ebbe098-f59e-4e9e-ad62-051a49380b1a admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:53.261017 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-9fea61b5-f2a6-4eec-bdb7-1863fe366b26 req-9ebbe098-f59e-4e9e-ad62-051a49380b1a admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:53.275148 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-9fea61b5-f2a6-4eec-bdb7-1863fe366b26 req-9ebbe098-f59e-4e9e-ad62-051a49380b1a admin admin] 10.222.0.46 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.080068 Sep 11 00:58:53.275765 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 199/389] 10.222.0.46 () {64 vars in 1326 bytes} [Sun Sep 11 00:58:53 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:58:53.350594 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-511a3865-d60b-4571-96eb-be0cc4b972b4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:53.359639 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-511a3865-d60b-4571-96eb-be0cc4b972b4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:53.361069 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-511a3865-d60b-4571-96eb-be0cc4b972b4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:53.362228 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-511a3865-d60b-4571-96eb-be0cc4b972b4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.156142 Sep 11 00:58:53.362780 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 191/390] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:53 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:54.391549 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3c77781b-861b-4ece-8efb-9a2d5edc1c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:54.392197 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3c77781b-861b-4ece-8efb-9a2d5edc1c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:54.398723 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c77781b-861b-4ece-8efb-9a2d5edc1c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:54.399611 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c77781b-861b-4ece-8efb-9a2d5edc1c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:54.399720 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c77781b-861b-4ece-8efb-9a2d5edc1c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:54.400380 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c77781b-861b-4ece-8efb-9a2d5edc1c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:54.400785 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c77781b-861b-4ece-8efb-9a2d5edc1c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:54.401250 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c77781b-861b-4ece-8efb-9a2d5edc1c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:54.541890 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3c77781b-861b-4ece-8efb-9a2d5edc1c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:54.551286 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3c77781b-861b-4ece-8efb-9a2d5edc1c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:54.552726 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3c77781b-861b-4ece-8efb-9a2d5edc1c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:54.553884 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3c77781b-861b-4ece-8efb-9a2d5edc1c0e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1809 microversion: 2.20 time: 0.167779 Sep 11 00:58:54.554433 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 200/391] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:54 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:55.580745 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-61c8fff2-b96d-4dc7-b0e1-57bc33e2ce02 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:55.581314 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-61c8fff2-b96d-4dc7-b0e1-57bc33e2ce02 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:55.588431 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-61c8fff2-b96d-4dc7-b0e1-57bc33e2ce02 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:55.588910 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-61c8fff2-b96d-4dc7-b0e1-57bc33e2ce02 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:55.589345 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-61c8fff2-b96d-4dc7-b0e1-57bc33e2ce02 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:55.590049 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-61c8fff2-b96d-4dc7-b0e1-57bc33e2ce02 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:55.590511 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-61c8fff2-b96d-4dc7-b0e1-57bc33e2ce02 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:55.590928 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-61c8fff2-b96d-4dc7-b0e1-57bc33e2ce02 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:55.726727 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-61c8fff2-b96d-4dc7-b0e1-57bc33e2ce02 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:55.737329 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-61c8fff2-b96d-4dc7-b0e1-57bc33e2ce02 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:55.738835 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-61c8fff2-b96d-4dc7-b0e1-57bc33e2ce02 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:55.740060 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-61c8fff2-b96d-4dc7-b0e1-57bc33e2ce02 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1796 microversion: 2.20 time: 0.163290 Sep 11 00:58:55.740631 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 192/392] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:58:55 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1796 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:58:57.580675 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-f501de18-13bc-4223-be47-13ddd04e4644 req-706ca34e-9b9d-4e25-8e61-a4787a33e10b admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "f03c1f40-8136-4843-9584-ed4fefc5ee0f", "create_info": {"type": "qcow2", "new_file": "volume-f03c1f40-8136-4843-9584-ed4fefc5ee0f.5f88aec4-94fd-4909-812b-dbc215ef643d.vhdx", "snapshot_id": "5f88aec4-94fd-4909-812b-dbc215ef643d"}}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:57.583998 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-f501de18-13bc-4223-be47-13ddd04e4644 req-706ca34e-9b9d-4e25-8e61-a4787a33e10b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:57.584471 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-f501de18-13bc-4223-be47-13ddd04e4644 req-706ca34e-9b9d-4e25-8e61-a4787a33e10b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:57.584893 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-f501de18-13bc-4223-be47-13ddd04e4644 req-706ca34e-9b9d-4e25-8e61-a4787a33e10b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:57.593571 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-f501de18-13bc-4223-be47-13ddd04e4644 req-706ca34e-9b9d-4e25-8e61-a4787a33e10b admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:57.594029 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-f501de18-13bc-4223-be47-13ddd04e4644 req-706ca34e-9b9d-4e25-8e61-a4787a33e10b admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:57.594486 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-f501de18-13bc-4223-be47-13ddd04e4644 req-706ca34e-9b9d-4e25-8e61-a4787a33e10b admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:57.608775 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-f501de18-13bc-4223-be47-13ddd04e4644 req-706ca34e-9b9d-4e25-8e61-a4787a33e10b admin admin] 10.222.0.46 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.080966 Sep 11 00:58:57.609349 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 201/393] 10.222.0.46 () {64 vars in 1326 bytes} [Sun Sep 11 00:58:57 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:58:59.368439 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8084e4ca-6a4c-48a1-a30a-5fdbd71076cf tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:59.369366 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8084e4ca-6a4c-48a1-a30a-5fdbd71076cf tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:59.377498 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8084e4ca-6a4c-48a1-a30a-5fdbd71076cf tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:59.378017 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8084e4ca-6a4c-48a1-a30a-5fdbd71076cf tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:59.378439 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8084e4ca-6a4c-48a1-a30a-5fdbd71076cf tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:59.379138 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8084e4ca-6a4c-48a1-a30a-5fdbd71076cf tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:59.379616 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8084e4ca-6a4c-48a1-a30a-5fdbd71076cf tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:59.380030 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8084e4ca-6a4c-48a1-a30a-5fdbd71076cf tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:59.409804 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8084e4ca-6a4c-48a1-a30a-5fdbd71076cf tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab/ips" status: 200 len: 150 microversion: 2.1 time: 0.047570 Sep 11 00:58:59.410277 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 193/394] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Sep 11 00:58:59 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:58:59.425167 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b0c27943-1f1c-495a-b44c-d298720e1dae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e10d8a5d-4639-4d3a-9a3e-89e1f1d4b962"}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:58:59.427596 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-b0c27943-1f1c-495a-b44c-d298720e1dae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:59.435447 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b0c27943-1f1c-495a-b44c-d298720e1dae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:59.435930 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b0c27943-1f1c-495a-b44c-d298720e1dae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:59.436361 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b0c27943-1f1c-495a-b44c-d298720e1dae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:59.437075 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b0c27943-1f1c-495a-b44c-d298720e1dae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:59.437653 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b0c27943-1f1c-495a-b44c-d298720e1dae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:59.438069 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b0c27943-1f1c-495a-b44c-d298720e1dae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:59.440529 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=80 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:59.520626 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-b0c27943-1f1c-495a-b44c-d298720e1dae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] HTTP exception thrown: Invalid volume: volume e10d8a5d-4639-4d3a-9a3e-89e1f1d4b962 is already attached to instances: a5a68ae4-8f64-474d-aca7-974bd8fd266a Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b0c27943-1f1c-495a-b44c-d298720e1dae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Request method failure captured: Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: POST /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab/os-volume_attachments HTTP/1.1 Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 74 Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTIZleOaEuAlKtiWOzScZQy__ERdzmN_Fsh18R3AG3G89WR_08snWZ6YRxuVmBkd8e4eDOuVoSFmU4H1_ArYPdT3bBFelG_bNniDYHGShKUr5tzXt-fC8Pp-PdXsUGSAqFcgcXiUSGpT-d-6G18Ajvb77CCwyMx9RJWxLsZjcUQaDz8 Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 00:58:59.522518 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 00:58:59.524255 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89e6e6a587374d53b8515f264dfd8cb6", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:58:59.524255 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-AttachVolumeNegativeTest-835741757 Sep 11 00:58:59.524255 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 00:58:59.524255 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 00:58:59.524255 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 00:58:59.524255 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 00:58:59.524255 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 00:58:59.524255 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 364cf4a7a3bf4e70973c78a5d690e998 Sep 11 00:58:59.524255 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 00:58:59.524255 dv-cinder-master-3-smb devstack@n-api.service[120497]: Sep 11 00:58:59.524255 dv-cinder-master-3-smb devstack@n-api.service[120497]: {"volumeAttachment": {"volumeId": "e10d8a5d-4639-4d3a-9a3e-89e1f1d4b962"}} Sep 11 00:58:59.524255 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Invalid volume: volume e10d8a5d-4639-4d3a-9a3e-89e1f1d4b962 is already attached to instances: a5a68ae4-8f64-474d-aca7-974bd8fd266a Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'server_id': 'a384877e-aaf3-4e9c-b99c-f98084c2ebab', 'body': {'volumeAttachment': {'volumeId': 'e10d8a5d-4639-4d3a-9a3e-89e1f1d4b962'}}} Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e10d8a5d-4639-4d3a-9a3e-89e1f1d4b962 is already attached to instances: a5a68ae4-8f64-474d-aca7-974bd8fd266a Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:58:59.525588 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e10d8a5d-4639-4d3a-9a3e-89e1f1d4b962 is already attached to instances: a5a68ae4-8f64-474d-aca7-974bd8fd266a Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:58:59.526779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:58:59.528938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:58:59.528938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:58:59.528938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:58:59.528938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e10d8a5d-4639-4d3a-9a3e-89e1f1d4b962 is already attached to instances: a5a68ae4-8f64-474d-aca7-974bd8fd266a Sep 11 00:58:59.528938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:58:59.528938 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b0c27943-1f1c-495a-b44c-d298720e1dae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Returning 400 to user: Invalid volume: volume e10d8a5d-4639-4d3a-9a3e-89e1f1d4b962 is already attached to instances: a5a68ae4-8f64-474d-aca7-974bd8fd266a {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:58:59.528938 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-b0c27943-1f1c-495a-b44c-d298720e1dae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "POST /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104137 Sep 11 00:58:59.528938 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 202/395] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Sep 11 00:58:59 2022] POST /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 00:58:59.533672 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-916c2206-e1bd-49f6-8601-430808e7435c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:59.534178 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-916c2206-e1bd-49f6-8601-430808e7435c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:59.540840 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-916c2206-e1bd-49f6-8601-430808e7435c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:59.541315 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-916c2206-e1bd-49f6-8601-430808e7435c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:59.542107 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-916c2206-e1bd-49f6-8601-430808e7435c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:59.542989 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-916c2206-e1bd-49f6-8601-430808e7435c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:59.543695 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-916c2206-e1bd-49f6-8601-430808e7435c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:59.544120 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-916c2206-e1bd-49f6-8601-430808e7435c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:59.570171 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-916c2206-e1bd-49f6-8601-430808e7435c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:58:59.649599 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-916c2206-e1bd-49f6-8601-430808e7435c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 204 len: 0 microversion: 2.1 time: 0.119533 Sep 11 00:58:59.650180 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 194/396] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 00:58:59 2022] DELETE /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:58:59.658283 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-64eabdc6-b2d4-4c0b-83a4-5b2e273f89a6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:58:59.658917 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-64eabdc6-b2d4-4c0b-83a4-5b2e273f89a6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:58:59.667200 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-64eabdc6-b2d4-4c0b-83a4-5b2e273f89a6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:59.667847 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-64eabdc6-b2d4-4c0b-83a4-5b2e273f89a6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:59.668362 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-64eabdc6-b2d4-4c0b-83a4-5b2e273f89a6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:59.669245 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-64eabdc6-b2d4-4c0b-83a4-5b2e273f89a6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:58:59.669857 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-64eabdc6-b2d4-4c0b-83a4-5b2e273f89a6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:58:59.670336 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-64eabdc6-b2d4-4c0b-83a4-5b2e273f89a6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:58:59.817144 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-64eabdc6-b2d4-4c0b-83a4-5b2e273f89a6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:58:59.825765 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-64eabdc6-b2d4-4c0b-83a4-5b2e273f89a6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1681 microversion: 2.1 time: 0.171310 Sep 11 00:58:59.826422 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 203/397] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:58:59 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:00.615435 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-0a232fac-96b8-4951-9ed6-d2854d572558 req-7a82a3da-11d1-480e-a2b4-bf412725b064 admin admin] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:00.623594 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [req-0a232fac-96b8-4951-9ed6-d2854d572558 req-7a82a3da-11d1-480e-a2b4-bf412725b064 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8719ce5-7462-4db4-8ae0-e38f988a1e8a(cell1) {{(pid=120496) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 11 00:59:00.624055 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0a232fac-96b8-4951-9ed6-d2854d572558 req-7a82a3da-11d1-480e-a2b4-bf412725b064 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:00.624552 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0a232fac-96b8-4951-9ed6-d2854d572558 req-7a82a3da-11d1-480e-a2b4-bf412725b064 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:00.624973 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0a232fac-96b8-4951-9ed6-d2854d572558 req-7a82a3da-11d1-480e-a2b4-bf412725b064 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:00.665457 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0a232fac-96b8-4951-9ed6-d2854d572558 req-7a82a3da-11d1-480e-a2b4-bf412725b064 admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:00.665921 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0a232fac-96b8-4951-9ed6-d2854d572558 req-7a82a3da-11d1-480e-a2b4-bf412725b064 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:00.666753 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0a232fac-96b8-4951-9ed6-d2854d572558 req-7a82a3da-11d1-480e-a2b4-bf412725b064 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:00.693227 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-0a232fac-96b8-4951-9ed6-d2854d572558 req-7a82a3da-11d1-480e-a2b4-bf412725b064 admin admin] 10.222.0.46 "DELETE /compute/v2.1/os-assisted-volume-snapshots/2978f88a-35b1-4fbf-a20e-8ccf5a907f53?delete_info=%7B%22file_to_merge%22:%20%22volume-f03c1f40-8136-4843-9584-ed4fefc5ee0f.2978f88a-35b1-4fbf-a20e-8ccf5a907f53.vhdx%22,%20%22volume_id%22:%20%22f03c1f40-8136-4843-9584-ed4fefc5ee0f%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.139311 Sep 11 00:59:00.694115 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 195/398] 10.222.0.46 () {62 vars in 1800 bytes} [Sun Sep 11 00:59:00 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/2978f88a-35b1-4fbf-a20e-8ccf5a907f53?delete_info=%7B%22file_to_merge%22:%20%22volume-f03c1f40-8136-4843-9584-ed4fefc5ee0f.2978f88a-35b1-4fbf-a20e-8ccf5a907f53.vhdx%22,%20%22volume_id%22:%20%22f03c1f40-8136-4843-9584-ed4fefc5ee0f%22%7D => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:59:00.853698 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-2efcfe33-f078-432f-b3a2-cc678fe0d39b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:00.854687 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-2efcfe33-f078-432f-b3a2-cc678fe0d39b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:00.865700 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2efcfe33-f078-432f-b3a2-cc678fe0d39b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:00.866542 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2efcfe33-f078-432f-b3a2-cc678fe0d39b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:00.867261 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2efcfe33-f078-432f-b3a2-cc678fe0d39b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:00.868489 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2efcfe33-f078-432f-b3a2-cc678fe0d39b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:00.869235 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2efcfe33-f078-432f-b3a2-cc678fe0d39b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:00.869944 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2efcfe33-f078-432f-b3a2-cc678fe0d39b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:01.001929 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-2efcfe33-f078-432f-b3a2-cc678fe0d39b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:01.010168 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-2efcfe33-f078-432f-b3a2-cc678fe0d39b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1681 microversion: 2.1 time: 0.163072 Sep 11 00:59:01.010713 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 204/399] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:00 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:02.039964 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-285f8d95-a160-4d9c-9fe0-240cebc0f972 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:02.041019 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-285f8d95-a160-4d9c-9fe0-240cebc0f972 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:02.049797 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-285f8d95-a160-4d9c-9fe0-240cebc0f972 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:02.050269 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-285f8d95-a160-4d9c-9fe0-240cebc0f972 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:02.050725 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-285f8d95-a160-4d9c-9fe0-240cebc0f972 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:02.051470 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-285f8d95-a160-4d9c-9fe0-240cebc0f972 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:02.051925 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-285f8d95-a160-4d9c-9fe0-240cebc0f972 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:02.052343 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-285f8d95-a160-4d9c-9fe0-240cebc0f972 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:02.189766 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-285f8d95-a160-4d9c-9fe0-240cebc0f972 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:02.198509 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-285f8d95-a160-4d9c-9fe0-240cebc0f972 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1681 microversion: 2.1 time: 0.166983 Sep 11 00:59:02.199205 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 196/400] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:02 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:03.222221 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-52e9c78d-7d61-48e7-82d7-6e555ed8b835 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:03.222830 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-52e9c78d-7d61-48e7-82d7-6e555ed8b835 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:03.230131 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-52e9c78d-7d61-48e7-82d7-6e555ed8b835 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:03.230619 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-52e9c78d-7d61-48e7-82d7-6e555ed8b835 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:03.231048 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-52e9c78d-7d61-48e7-82d7-6e555ed8b835 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:03.231768 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-52e9c78d-7d61-48e7-82d7-6e555ed8b835 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:03.232215 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-52e9c78d-7d61-48e7-82d7-6e555ed8b835 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:03.232632 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-52e9c78d-7d61-48e7-82d7-6e555ed8b835 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:03.306300 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-52e9c78d-7d61-48e7-82d7-6e555ed8b835 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:03.314280 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-52e9c78d-7d61-48e7-82d7-6e555ed8b835 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1614 microversion: 2.1 time: 0.096175 Sep 11 00:59:03.314865 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 205/401] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:03 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:03.565827 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-89ae024b-2e16-466b-b877-127206e9c3db req-ca00249a-3101-49ce-8434-c001da18b9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a384877e-aaf3-4e9c-b99c-f98084c2ebab", "name": "network-vif-deleted", "tag": "d347821a-deb0-4b3c-b6d4-e1f4f98e348f"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:03.578892 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-89ae024b-2e16-466b-b877-127206e9c3db req-ca00249a-3101-49ce-8434-c001da18b9a9 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:03.579418 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-89ae024b-2e16-466b-b877-127206e9c3db req-ca00249a-3101-49ce-8434-c001da18b9a9 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:03.579864 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-89ae024b-2e16-466b-b877-127206e9c3db req-ca00249a-3101-49ce-8434-c001da18b9a9 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:03.592041 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-89ae024b-2e16-466b-b877-127206e9c3db req-ca00249a-3101-49ce-8434-c001da18b9a9 service nova] Creating event network-vif-deleted:d347821a-deb0-4b3c-b6d4-e1f4f98e348f for instance a384877e-aaf3-4e9c-b99c-f98084c2ebab on hv-cinder-maste Sep 11 00:59:03.597539 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-89ae024b-2e16-466b-b877-127206e9c3db req-ca00249a-3101-49ce-8434-c001da18b9a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035403 Sep 11 00:59:03.598777 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 197/402] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:04.338174 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ef7df4d4-131e-4f9d-b52c-dfba0cd90eae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:04.339009 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ef7df4d4-131e-4f9d-b52c-dfba0cd90eae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:04.345254 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef7df4d4-131e-4f9d-b52c-dfba0cd90eae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:04.345871 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef7df4d4-131e-4f9d-b52c-dfba0cd90eae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:04.346397 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef7df4d4-131e-4f9d-b52c-dfba0cd90eae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:04.347215 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef7df4d4-131e-4f9d-b52c-dfba0cd90eae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:04.347760 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef7df4d4-131e-4f9d-b52c-dfba0cd90eae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:04.348290 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef7df4d4-131e-4f9d-b52c-dfba0cd90eae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:04.379894 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef7df4d4-131e-4f9d-b52c-dfba0cd90eae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:04.380519 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef7df4d4-131e-4f9d-b52c-dfba0cd90eae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:04.381044 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ef7df4d4-131e-4f9d-b52c-dfba0cd90eae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:04.381588 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-ef7df4d4-131e-4f9d-b52c-dfba0cd90eae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lazy-loading 'fault' on Instance uuid a384877e-aaf3-4e9c-b99c-f98084c2ebab {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:59:04.428368 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ef7df4d4-131e-4f9d-b52c-dfba0cd90eae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:04.437114 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ef7df4d4-131e-4f9d-b52c-dfba0cd90eae tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 200 len: 1331 microversion: 2.1 time: 0.102813 Sep 11 00:59:04.439517 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 206/403] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:04 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:04.842609 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-3932b8da-7288-4968-85c2-d0d059668516 req-faa586fd-ff1e-427e-b975-4ff2ff820459 admin admin] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:04.845975 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3932b8da-7288-4968-85c2-d0d059668516 req-faa586fd-ff1e-427e-b975-4ff2ff820459 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:04.846461 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3932b8da-7288-4968-85c2-d0d059668516 req-faa586fd-ff1e-427e-b975-4ff2ff820459 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:04.846887 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3932b8da-7288-4968-85c2-d0d059668516 req-faa586fd-ff1e-427e-b975-4ff2ff820459 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:04.856916 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3932b8da-7288-4968-85c2-d0d059668516 req-faa586fd-ff1e-427e-b975-4ff2ff820459 admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:04.857403 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3932b8da-7288-4968-85c2-d0d059668516 req-faa586fd-ff1e-427e-b975-4ff2ff820459 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:04.857831 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3932b8da-7288-4968-85c2-d0d059668516 req-faa586fd-ff1e-427e-b975-4ff2ff820459 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:04.872302 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-3932b8da-7288-4968-85c2-d0d059668516 req-faa586fd-ff1e-427e-b975-4ff2ff820459 admin admin] 10.222.0.46 "DELETE /compute/v2.1/os-assisted-volume-snapshots/5f88aec4-94fd-4909-812b-dbc215ef643d?delete_info=%7B%22file_to_merge%22:%20%22volume-f03c1f40-8136-4843-9584-ed4fefc5ee0f.5f88aec4-94fd-4909-812b-dbc215ef643d.vhdx%22,%20%22volume_id%22:%20%22f03c1f40-8136-4843-9584-ed4fefc5ee0f%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.096593 Sep 11 00:59:04.872922 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 198/404] 10.222.0.46 () {62 vars in 1800 bytes} [Sun Sep 11 00:59:04 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/5f88aec4-94fd-4909-812b-dbc215ef643d?delete_info=%7B%22file_to_merge%22:%20%22volume-f03c1f40-8136-4843-9584-ed4fefc5ee0f.5f88aec4-94fd-4909-812b-dbc215ef643d.vhdx%22,%20%22volume_id%22:%20%22f03c1f40-8136-4843-9584-ed4fefc5ee0f%22%7D => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:59:05.464470 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0b9bdf61-60dc-4792-930a-3fab4a02fa11 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:05.465534 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-0b9bdf61-60dc-4792-930a-3fab4a02fa11 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:05.472757 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0b9bdf61-60dc-4792-930a-3fab4a02fa11 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:05.473189 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0b9bdf61-60dc-4792-930a-3fab4a02fa11 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:05.473621 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0b9bdf61-60dc-4792-930a-3fab4a02fa11 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:05.474316 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0b9bdf61-60dc-4792-930a-3fab4a02fa11 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:05.474753 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0b9bdf61-60dc-4792-930a-3fab4a02fa11 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:05.475214 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0b9bdf61-60dc-4792-930a-3fab4a02fa11 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:05.488986 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-0b9bdf61-60dc-4792-930a-3fab4a02fa11 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] HTTP exception thrown: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0b9bdf61-60dc-4792-930a-3fab4a02fa11 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Request method failure captured: Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab HTTP/1.1 Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTIZleOaEuAlKtiWOzScZQy__ERdzmN_Fsh18R3AG3G89WR_08snWZ6YRxuVmBkd8e4eDOuVoSFmU4H1_ArYPdT3bBFelG_bNniDYHGShKUr5tzXt-fC8Pp-PdXsUGSAqFcgcXiUSGpT-d-6G18Ajvb77CCwyMx9RJWxLsZjcUQaDz8 Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 00:59:05.490543 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 00:59:05.492142 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89e6e6a587374d53b8515f264dfd8cb6", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:59:05.492142 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-AttachVolumeNegativeTest-835741757 Sep 11 00:59:05.492142 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 00:59:05.492142 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 00:59:05.492142 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 00:59:05.492142 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 00:59:05.492142 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 00:59:05.492142 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 364cf4a7a3bf4e70973c78a5d690e998 Sep 11 00:59:05.492142 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 00:59:05.492142 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 00:59:05.492142 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 00:59:05.492142 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': 'a384877e-aaf3-4e9c-b99c-f98084c2ebab'} Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:59:05.493011 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 00:59:05.494452 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:59:05.495752 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0b9bdf61-60dc-4792-930a-3fab4a02fa11 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Returning 404 to user: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:59:05.495752 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0b9bdf61-60dc-4792-930a-3fab4a02fa11 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 404 len: 111 microversion: 2.1 time: 0.034131 Sep 11 00:59:05.495752 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 207/405] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:05 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:59:05.501568 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-945db0d9-1d90-4f32-ac64-b122227ca3b3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '.version_select at 0x7fbb90806e50>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:05.525754 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-945db0d9-1d90-4f32-ac64-b122227ca3b3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1085731562" status: 202 len: 0 microversion: 2.1 time: 0.028136 Sep 11 00:59:05.526779 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 199/406] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Sep 11 00:59:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1085731562 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:59:06.214472 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d4f2f016-44d2-4310-a796-bd98de9e6cfd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:06.214962 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d4f2f016-44d2-4310-a796-bd98de9e6cfd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:06.221091 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d4f2f016-44d2-4310-a796-bd98de9e6cfd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:06.221570 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d4f2f016-44d2-4310-a796-bd98de9e6cfd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:06.221998 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d4f2f016-44d2-4310-a796-bd98de9e6cfd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:06.222682 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d4f2f016-44d2-4310-a796-bd98de9e6cfd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:06.223128 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d4f2f016-44d2-4310-a796-bd98de9e6cfd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:06.223574 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d4f2f016-44d2-4310-a796-bd98de9e6cfd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:06.350904 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-d4f2f016-44d2-4310-a796-bd98de9e6cfd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lazy-loading 'services' on Instance uuid a5a68ae4-8f64-474d-aca7-974bd8fd266a {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:59:06.467547 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d4f2f016-44d2-4310-a796-bd98de9e6cfd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a/os-volume_attachments/e10d8a5d-4639-4d3a-9a3e-89e1f1d4b962" status: 202 len: 0 microversion: 2.1 time: 0.256860 Sep 11 00:59:06.468195 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 208/407] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Sep 11 00:59:06 2022] DELETE /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a/os-volume_attachments/e10d8a5d-4639-4d3a-9a3e-89e1f1d4b962 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:59:06.479140 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-17a983e0-426f-40b0-9cbc-8fc67fc4ece4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:06.481476 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-17a983e0-426f-40b0-9cbc-8fc67fc4ece4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:06.488503 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17a983e0-426f-40b0-9cbc-8fc67fc4ece4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:06.488985 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17a983e0-426f-40b0-9cbc-8fc67fc4ece4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:06.489390 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17a983e0-426f-40b0-9cbc-8fc67fc4ece4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:06.490134 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17a983e0-426f-40b0-9cbc-8fc67fc4ece4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:06.490583 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17a983e0-426f-40b0-9cbc-8fc67fc4ece4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:06.491003 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17a983e0-426f-40b0-9cbc-8fc67fc4ece4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:06.505088 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:06.523357 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-17a983e0-426f-40b0-9cbc-8fc67fc4ece4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048771 Sep 11 00:59:06.523924 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 200/408] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 00:59:06 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:07.539452 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-030718e4-d903-4039-98f0-c3a9be88b09a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:07.542312 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-030718e4-d903-4039-98f0-c3a9be88b09a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:07.548893 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-030718e4-d903-4039-98f0-c3a9be88b09a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:07.549372 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-030718e4-d903-4039-98f0-c3a9be88b09a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:07.549822 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-030718e4-d903-4039-98f0-c3a9be88b09a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:07.550519 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-030718e4-d903-4039-98f0-c3a9be88b09a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:07.551048 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-030718e4-d903-4039-98f0-c3a9be88b09a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:07.551484 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-030718e4-d903-4039-98f0-c3a9be88b09a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:07.584558 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-030718e4-d903-4039-98f0-c3a9be88b09a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050033 Sep 11 00:59:07.585156 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 209/409] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 00:59:07 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:59:07.661335 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-09b4278e-be58-4004-8dce-6b8b7c491f09 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:07.661878 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-09b4278e-be58-4004-8dce-6b8b7c491f09 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:07.669901 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-09b4278e-be58-4004-8dce-6b8b7c491f09 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:07.670592 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-09b4278e-be58-4004-8dce-6b8b7c491f09 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:07.671341 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-09b4278e-be58-4004-8dce-6b8b7c491f09 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:07.672044 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-09b4278e-be58-4004-8dce-6b8b7c491f09 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:07.672496 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-09b4278e-be58-4004-8dce-6b8b7c491f09 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:07.672926 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-09b4278e-be58-4004-8dce-6b8b7c491f09 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:07.698450 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-09b4278e-be58-4004-8dce-6b8b7c491f09 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:59:07.781851 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-09b4278e-be58-4004-8dce-6b8b7c491f09 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 204 len: 0 microversion: 2.1 time: 0.124193 Sep 11 00:59:07.783018 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 201/410] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 00:59:07 2022] DELETE /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:59:07.792013 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5ecb9ca5-6c8e-446e-8664-3b0617fcb430 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:07.792854 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-5ecb9ca5-6c8e-446e-8664-3b0617fcb430 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:07.795166 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=6 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:07.801323 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ecb9ca5-6c8e-446e-8664-3b0617fcb430 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:07.801789 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ecb9ca5-6c8e-446e-8664-3b0617fcb430 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:07.802220 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ecb9ca5-6c8e-446e-8664-3b0617fcb430 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:07.802920 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ecb9ca5-6c8e-446e-8664-3b0617fcb430 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:07.803475 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ecb9ca5-6c8e-446e-8664-3b0617fcb430 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:07.803896 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ecb9ca5-6c8e-446e-8664-3b0617fcb430 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:07.946187 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-5ecb9ca5-6c8e-446e-8664-3b0617fcb430 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:07.954195 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-5ecb9ca5-6c8e-446e-8664-3b0617fcb430 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1679 microversion: 2.1 time: 0.166673 Sep 11 00:59:07.954753 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 210/411] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:07 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:08.016122 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-897bd9d8-7acb-4fd5-bb6b-1601d44999f9 req-542ebd90-28da-4872-a239-737419914b3c admin admin] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:08.019404 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-897bd9d8-7acb-4fd5-bb6b-1601d44999f9 req-542ebd90-28da-4872-a239-737419914b3c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:08.019882 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-897bd9d8-7acb-4fd5-bb6b-1601d44999f9 req-542ebd90-28da-4872-a239-737419914b3c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:08.020315 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-897bd9d8-7acb-4fd5-bb6b-1601d44999f9 req-542ebd90-28da-4872-a239-737419914b3c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:08.029320 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-897bd9d8-7acb-4fd5-bb6b-1601d44999f9 req-542ebd90-28da-4872-a239-737419914b3c admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:08.029794 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-897bd9d8-7acb-4fd5-bb6b-1601d44999f9 req-542ebd90-28da-4872-a239-737419914b3c admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:08.030224 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-897bd9d8-7acb-4fd5-bb6b-1601d44999f9 req-542ebd90-28da-4872-a239-737419914b3c admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:08.043738 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-897bd9d8-7acb-4fd5-bb6b-1601d44999f9 req-542ebd90-28da-4872-a239-737419914b3c admin admin] 10.222.0.46 "DELETE /compute/v2.1/os-assisted-volume-snapshots/1d72130e-33aa-4dd7-b8c8-c5fdf0bed0f4?delete_info=%7B%22file_to_merge%22:%20%22volume-f03c1f40-8136-4843-9584-ed4fefc5ee0f.1d72130e-33aa-4dd7-b8c8-c5fdf0bed0f4.vhdx%22,%20%22volume_id%22:%20%22f03c1f40-8136-4843-9584-ed4fefc5ee0f%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.080451 Sep 11 00:59:08.044306 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 202/412] 10.222.0.46 () {62 vars in 1800 bytes} [Sun Sep 11 00:59:07 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/1d72130e-33aa-4dd7-b8c8-c5fdf0bed0f4?delete_info=%7B%22file_to_merge%22:%20%22volume-f03c1f40-8136-4843-9584-ed4fefc5ee0f.1d72130e-33aa-4dd7-b8c8-c5fdf0bed0f4.vhdx%22,%20%22volume_id%22:%20%22f03c1f40-8136-4843-9584-ed4fefc5ee0f%22%7D => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:59:08.981680 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-612c3592-9503-42bc-bcde-f807b43c13b4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:08.982746 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-612c3592-9503-42bc-bcde-f807b43c13b4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:08.993721 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-612c3592-9503-42bc-bcde-f807b43c13b4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:08.994516 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-612c3592-9503-42bc-bcde-f807b43c13b4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:08.995237 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-612c3592-9503-42bc-bcde-f807b43c13b4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:08.996414 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-612c3592-9503-42bc-bcde-f807b43c13b4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:08.997168 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-612c3592-9503-42bc-bcde-f807b43c13b4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:08.997912 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-612c3592-9503-42bc-bcde-f807b43c13b4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:09.069387 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-99a78419-90f9-4a1e-a71e-b8a3195a88c4 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:09.070029 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-99a78419-90f9-4a1e-a71e-b8a3195a88c4 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:09.076519 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-99a78419-90f9-4a1e-a71e-b8a3195a88c4 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:09.077007 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-99a78419-90f9-4a1e-a71e-b8a3195a88c4 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:09.077986 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-99a78419-90f9-4a1e-a71e-b8a3195a88c4 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:09.078173 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-99a78419-90f9-4a1e-a71e-b8a3195a88c4 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:09.078652 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-99a78419-90f9-4a1e-a71e-b8a3195a88c4 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:09.079084 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-99a78419-90f9-4a1e-a71e-b8a3195a88c4 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:09.133960 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-612c3592-9503-42bc-bcde-f807b43c13b4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:09.141891 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-612c3592-9503-42bc-bcde-f807b43c13b4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1679 microversion: 2.1 time: 0.166868 Sep 11 00:59:09.155204 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 211/413] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:08 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:09.217746 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-99a78419-90f9-4a1e-a71e-b8a3195a88c4 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lazy-loading 'services' on Instance uuid 11702158-2435-4d46-9e27-7ff56d83bca8 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:59:09.344457 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-99a78419-90f9-4a1e-a71e-b8a3195a88c4 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "DELETE /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/os-volume_attachments/240a1b49-0068-4155-a2e0-feebe70b17fb" status: 202 len: 0 microversion: 2.1 time: 0.280850 Sep 11 00:59:09.345060 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 203/414] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Sep 11 00:59:09 2022] DELETE /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/os-volume_attachments/240a1b49-0068-4155-a2e0-feebe70b17fb => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:59:10.170296 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ce216daf-3bd8-4e68-bc00-f13ebb17374a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:10.171013 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ce216daf-3bd8-4e68-bc00-f13ebb17374a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:10.180577 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ce216daf-3bd8-4e68-bc00-f13ebb17374a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:10.181066 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ce216daf-3bd8-4e68-bc00-f13ebb17374a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:10.181481 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ce216daf-3bd8-4e68-bc00-f13ebb17374a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:10.182197 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ce216daf-3bd8-4e68-bc00-f13ebb17374a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:10.182647 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ce216daf-3bd8-4e68-bc00-f13ebb17374a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:10.183065 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ce216daf-3bd8-4e68-bc00-f13ebb17374a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:10.316019 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ce216daf-3bd8-4e68-bc00-f13ebb17374a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:10.327024 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ce216daf-3bd8-4e68-bc00-f13ebb17374a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1679 microversion: 2.1 time: 0.163648 Sep 11 00:59:10.327626 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 212/415] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:10 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:11.351653 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8a47b6de-82ea-466c-8fdb-4d970cfa2643 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:11.352348 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8a47b6de-82ea-466c-8fdb-4d970cfa2643 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:11.359049 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a47b6de-82ea-466c-8fdb-4d970cfa2643 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:11.359564 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a47b6de-82ea-466c-8fdb-4d970cfa2643 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:11.359995 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a47b6de-82ea-466c-8fdb-4d970cfa2643 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:11.360717 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a47b6de-82ea-466c-8fdb-4d970cfa2643 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:11.361158 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a47b6de-82ea-466c-8fdb-4d970cfa2643 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:11.361579 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a47b6de-82ea-466c-8fdb-4d970cfa2643 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:11.506643 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8a47b6de-82ea-466c-8fdb-4d970cfa2643 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:11.516199 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8a47b6de-82ea-466c-8fdb-4d970cfa2643 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1679 microversion: 2.1 time: 0.169657 Sep 11 00:59:11.516773 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 204/416] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:11 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:12.178346 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-7df0a662-3882-4153-88a4-1fbf52bb9849 req-befdd240-b7b2-425e-ba46-e69cad988f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a68ae4-8f64-474d-aca7-974bd8fd266a", "name": "network-vif-deleted", "tag": "45e6e7a2-cde7-4a70-8d40-d6a3344f9545"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:12.188619 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-7df0a662-3882-4153-88a4-1fbf52bb9849 req-befdd240-b7b2-425e-ba46-e69cad988f34 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:12.189100 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-7df0a662-3882-4153-88a4-1fbf52bb9849 req-befdd240-b7b2-425e-ba46-e69cad988f34 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:12.189764 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-7df0a662-3882-4153-88a4-1fbf52bb9849 req-befdd240-b7b2-425e-ba46-e69cad988f34 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:12.201445 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-7df0a662-3882-4153-88a4-1fbf52bb9849 req-befdd240-b7b2-425e-ba46-e69cad988f34 service nova] Creating event network-vif-deleted:45e6e7a2-cde7-4a70-8d40-d6a3344f9545 for instance a5a68ae4-8f64-474d-aca7-974bd8fd266a on hv-cinder-maste Sep 11 00:59:12.207950 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-7df0a662-3882-4153-88a4-1fbf52bb9849 req-befdd240-b7b2-425e-ba46-e69cad988f34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032964 Sep 11 00:59:12.209577 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 213/417] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:12.545064 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9c68653b-ebc3-456b-a0ab-8622586b2e4d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:12.545707 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9c68653b-ebc3-456b-a0ab-8622586b2e4d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:12.554528 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c68653b-ebc3-456b-a0ab-8622586b2e4d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:12.554944 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c68653b-ebc3-456b-a0ab-8622586b2e4d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:12.555599 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c68653b-ebc3-456b-a0ab-8622586b2e4d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:12.556341 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c68653b-ebc3-456b-a0ab-8622586b2e4d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:12.556795 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c68653b-ebc3-456b-a0ab-8622586b2e4d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:12.557251 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c68653b-ebc3-456b-a0ab-8622586b2e4d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:12.593881 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c68653b-ebc3-456b-a0ab-8622586b2e4d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:12.595110 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c68653b-ebc3-456b-a0ab-8622586b2e4d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:12.597012 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c68653b-ebc3-456b-a0ab-8622586b2e4d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:12.597628 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-9c68653b-ebc3-456b-a0ab-8622586b2e4d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lazy-loading 'fault' on Instance uuid a5a68ae4-8f64-474d-aca7-974bd8fd266a {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:59:12.625619 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-66af9016-bdab-4e56-bdec-9980bb2a8461 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:12.632567 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-66af9016-bdab-4e56-bdec-9980bb2a8461 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:12.633973 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-66af9016-bdab-4e56-bdec-9980bb2a8461 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:12.634886 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-66af9016-bdab-4e56-bdec-9980bb2a8461 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:12.654611 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-9c68653b-ebc3-456b-a0ab-8622586b2e4d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:12.663046 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9c68653b-ebc3-456b-a0ab-8622586b2e4d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 200 len: 1329 microversion: 2.1 time: 0.122402 Sep 11 00:59:12.664010 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 205/418] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:12 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 1329 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:12.700654 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-66af9016-bdab-4e56-bdec-9980bb2a8461 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Going to try to stop instance {{(pid=120497) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 11 00:59:12.747070 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-66af9016-bdab-4e56-bdec-9980bb2a8461 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "POST /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/action" status: 202 len: 0 microversion: 2.1 time: 0.127247 Sep 11 00:59:12.748003 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 214/419] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Sep 11 00:59:12 2022] POST /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 00:59:12.757206 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-464b6628-91bd-4fd6-9f92-56e75e5611e0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:12.757821 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-464b6628-91bd-4fd6-9f92-56e75e5611e0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:12.763944 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-464b6628-91bd-4fd6-9f92-56e75e5611e0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:12.764516 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-464b6628-91bd-4fd6-9f92-56e75e5611e0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:12.765040 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-464b6628-91bd-4fd6-9f92-56e75e5611e0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:12.765790 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-464b6628-91bd-4fd6-9f92-56e75e5611e0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:12.766243 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-464b6628-91bd-4fd6-9f92-56e75e5611e0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:12.766658 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-464b6628-91bd-4fd6-9f92-56e75e5611e0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:12.902246 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-464b6628-91bd-4fd6-9f92-56e75e5611e0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:12.910305 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-464b6628-91bd-4fd6-9f92-56e75e5611e0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1676 microversion: 2.1 time: 0.157023 Sep 11 00:59:12.910887 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 206/420] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:12 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:13.023390 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b520d310-2879-4154-b56f-e3a393a56805 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:13.024092 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-b520d310-2879-4154-b56f-e3a393a56805 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:13.031029 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b520d310-2879-4154-b56f-e3a393a56805 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:13.031485 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b520d310-2879-4154-b56f-e3a393a56805 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:13.031917 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b520d310-2879-4154-b56f-e3a393a56805 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:13.032624 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b520d310-2879-4154-b56f-e3a393a56805 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:13.033072 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b520d310-2879-4154-b56f-e3a393a56805 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:13.033495 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b520d310-2879-4154-b56f-e3a393a56805 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:13.134086 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-b520d310-2879-4154-b56f-e3a393a56805 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lazy-loading 'services' on Instance uuid 84067194-1977-4b94-8372-f37a77fe546f {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:59:13.212269 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-b520d310-2879-4154-b56f-e3a393a56805 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f/os-volume_attachments/f03c1f40-8136-4843-9584-ed4fefc5ee0f" status: 202 len: 0 microversion: 2.1 time: 0.193049 Sep 11 00:59:13.212905 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 215/421] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Sep 11 00:59:13 2022] DELETE /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f/os-volume_attachments/f03c1f40-8136-4843-9584-ed4fefc5ee0f => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:59:13.689327 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8cd408d5-98eb-47e3-ab53-45ea07687d3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:13.689871 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8cd408d5-98eb-47e3-ab53-45ea07687d3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:13.696460 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8cd408d5-98eb-47e3-ab53-45ea07687d3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:13.696945 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8cd408d5-98eb-47e3-ab53-45ea07687d3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:13.697376 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8cd408d5-98eb-47e3-ab53-45ea07687d3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:13.698062 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8cd408d5-98eb-47e3-ab53-45ea07687d3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:13.698509 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8cd408d5-98eb-47e3-ab53-45ea07687d3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:13.698929 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8cd408d5-98eb-47e3-ab53-45ea07687d3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:13.712657 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-8cd408d5-98eb-47e3-ab53-45ea07687d3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] HTTP exception thrown: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8cd408d5-98eb-47e3-ab53-45ea07687d3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Request method failure captured: Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a HTTP/1.1 Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIZleOaEuAlKtiWOzScZQy__ERdzmN_Fsh18R3AG3G89WR_08snWZ6YRxuVmBkd8e4eDOuVoSFmU4H1_ArYPdT3bBFelG_bNniDYHGShKUr5tzXt-fC8Pp-PdXsUGSAqFcgcXiUSGpT-d-6G18Ajvb77CCwyMx9RJWxLsZjcUQaDz8 Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 00:59:13.714282 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 00:59:13.715840 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89e6e6a587374d53b8515f264dfd8cb6", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:59:13.715840 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-835741757 Sep 11 00:59:13.715840 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 00:59:13.715840 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 00:59:13.715840 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 00:59:13.715840 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 00:59:13.715840 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 00:59:13.715840 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 364cf4a7a3bf4e70973c78a5d690e998 Sep 11 00:59:13.715840 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 00:59:13.715840 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 00:59:13.715840 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 00:59:13.715840 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': 'a5a68ae4-8f64-474d-aca7-974bd8fd266a'} Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:59:13.717007 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 00:59:13.718507 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:13.720047 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8cd408d5-98eb-47e3-ab53-45ea07687d3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Returning 404 to user: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:59:13.720047 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8cd408d5-98eb-47e3-ab53-45ea07687d3d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 404 len: 111 microversion: 2.1 time: 0.031571 Sep 11 00:59:13.720047 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 207/422] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:13 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:59:13.725246 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-aa4c02fb-8ca0-4204-b2f4-41b55faad765 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '.version_select at 0x7fbb906f9a60>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:13.747802 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-aa4c02fb-8ca0-4204-b2f4-41b55faad765 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-97942345" status: 202 len: 0 microversion: 2.1 time: 0.026809 Sep 11 00:59:13.748353 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 216/423] 10.222.0.23 () {58 vars in 1215 bytes} [Sun Sep 11 00:59:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-97942345 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:59:13.933934 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7ec4f755-f3df-4043-b260-d4f980b41525 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:13.934541 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7ec4f755-f3df-4043-b260-d4f980b41525 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:13.944513 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ec4f755-f3df-4043-b260-d4f980b41525 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:13.945155 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ec4f755-f3df-4043-b260-d4f980b41525 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:13.945585 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ec4f755-f3df-4043-b260-d4f980b41525 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:13.946277 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ec4f755-f3df-4043-b260-d4f980b41525 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:13.946724 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ec4f755-f3df-4043-b260-d4f980b41525 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:13.947165 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ec4f755-f3df-4043-b260-d4f980b41525 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:14.094031 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-7ec4f755-f3df-4043-b260-d4f980b41525 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:14.102027 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7ec4f755-f3df-4043-b260-d4f980b41525 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1676 microversion: 2.1 time: 0.171890 Sep 11 00:59:14.102959 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 208/424] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:13 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:14.346747 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f2eed76b-73a1-434a-bed1-796b48d37f9e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:14.347343 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f2eed76b-73a1-434a-bed1-796b48d37f9e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:14.354287 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2eed76b-73a1-434a-bed1-796b48d37f9e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:14.354850 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2eed76b-73a1-434a-bed1-796b48d37f9e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:14.355297 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2eed76b-73a1-434a-bed1-796b48d37f9e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:14.356106 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2eed76b-73a1-434a-bed1-796b48d37f9e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:14.356544 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2eed76b-73a1-434a-bed1-796b48d37f9e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:14.356963 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2eed76b-73a1-434a-bed1-796b48d37f9e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:14.382353 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f2eed76b-73a1-434a-bed1-796b48d37f9e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Going to try to terminate instance {{(pid=120497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:59:14.407514 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:14.408936 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a586be49-fe43-4d2a-9aa7-0854aa5c31c0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Action: 'create', calling method: .version_select at 0x7fbb907a2940>, body: {"keypair": {"name": "tempest-keypair-454993795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWxByCKRPuaGLwJyEN9EhCFL34tU6WPCx7iP3dgjzmsGHS9Mqv4oL8ZN7yu8o02Mog5vwkUUA6LVZvRZowyYLjgHcaZumU58MfVJ4vrCgebgM4TKhHAsC12raA70ZDjWA=="}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:14.425778 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-a586be49-fe43-4d2a-9aa7-0854aa5c31c0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:59:14.429641 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-a586be49-fe43-4d2a-9aa7-0854aa5c31c0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for user 364cf4a7a3bf4e70973c78a5d690e998 and project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:59:14.461184 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a586be49-fe43-4d2a-9aa7-0854aa5c31c0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055848 Sep 11 00:59:14.461877 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 209/425] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Sep 11 00:59:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 00:59:14.463780 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f2eed76b-73a1-434a-bed1-796b48d37f9e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 204 len: 0 microversion: 2.1 time: 0.119201 Sep 11 00:59:14.467683 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 217/426] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 00:59:14 2022] DELETE /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:59:14.473926 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7d86adbf-6fa3-4a6d-bf32-ff8286fcbb2b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:14.474569 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7d86adbf-6fa3-4a6d-bf32-ff8286fcbb2b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:14.480718 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7d86adbf-6fa3-4a6d-bf32-ff8286fcbb2b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:14.481197 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7d86adbf-6fa3-4a6d-bf32-ff8286fcbb2b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:14.481619 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7d86adbf-6fa3-4a6d-bf32-ff8286fcbb2b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:14.482307 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7d86adbf-6fa3-4a6d-bf32-ff8286fcbb2b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:14.482748 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7d86adbf-6fa3-4a6d-bf32-ff8286fcbb2b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:14.483207 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7d86adbf-6fa3-4a6d-bf32-ff8286fcbb2b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:14.673407 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-7d86adbf-6fa3-4a6d-bf32-ff8286fcbb2b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:14.683230 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7d86adbf-6fa3-4a6d-bf32-ff8286fcbb2b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1513 microversion: 2.1 time: 0.213435 Sep 11 00:59:14.699554 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 210/427] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:14 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:15.126661 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a749f220-34df-4702-b59b-315093b1cc56 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:15.127316 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a749f220-34df-4702-b59b-315093b1cc56 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:15.129404 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:15.134883 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a749f220-34df-4702-b59b-315093b1cc56 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:15.135393 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a749f220-34df-4702-b59b-315093b1cc56 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:15.135822 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a749f220-34df-4702-b59b-315093b1cc56 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:15.136511 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a749f220-34df-4702-b59b-315093b1cc56 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:15.136951 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a749f220-34df-4702-b59b-315093b1cc56 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:15.137364 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a749f220-34df-4702-b59b-315093b1cc56 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:15.359565 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a749f220-34df-4702-b59b-315093b1cc56 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:15.367680 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a749f220-34df-4702-b59b-315093b1cc56 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1676 microversion: 2.1 time: 0.245694 Sep 11 00:59:15.368272 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 218/428] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:15 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:15.709298 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-13a0c880-03c0-4aa5-bd2f-4f1482c5f9f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:15.709876 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-13a0c880-03c0-4aa5-bd2f-4f1482c5f9f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:15.716668 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-13a0c880-03c0-4aa5-bd2f-4f1482c5f9f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:15.717145 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-13a0c880-03c0-4aa5-bd2f-4f1482c5f9f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:15.717679 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-13a0c880-03c0-4aa5-bd2f-4f1482c5f9f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:15.718385 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-13a0c880-03c0-4aa5-bd2f-4f1482c5f9f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:15.718836 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-13a0c880-03c0-4aa5-bd2f-4f1482c5f9f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:15.719275 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-13a0c880-03c0-4aa5-bd2f-4f1482c5f9f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:15.924039 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-13a0c880-03c0-4aa5-bd2f-4f1482c5f9f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:15.932003 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-13a0c880-03c0-4aa5-bd2f-4f1482c5f9f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1513 microversion: 2.1 time: 0.226865 Sep 11 00:59:15.932613 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 211/429] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:15 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:16.000093 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-940726966", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "245b555a-f171-4b26-8562-bbe3df87effe"}], "security_groups": [{"name": "tempest-securitygroup--1079594827"}], "key_name": "tempest-keypair-454993795", "user_data": "}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:16.114710 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.network.neutron [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] validate_networks() for [('245b555a-f171-4b26-8562-bbe3df87effe', None, None, None, None, None)] {{(pid=120497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:59:16.390429 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0217e07c-5e7a-4429-ba6e-ede54f7a17d2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:16.391041 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0217e07c-5e7a-4429-ba6e-ede54f7a17d2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:16.397295 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0217e07c-5e7a-4429-ba6e-ede54f7a17d2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:16.397759 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0217e07c-5e7a-4429-ba6e-ede54f7a17d2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:16.398213 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0217e07c-5e7a-4429-ba6e-ede54f7a17d2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:16.398944 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0217e07c-5e7a-4429-ba6e-ede54f7a17d2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:16.399586 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0217e07c-5e7a-4429-ba6e-ede54f7a17d2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:16.400015 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0217e07c-5e7a-4429-ba6e-ede54f7a17d2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:16.572816 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Flavor limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:59:16.573340 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Image limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:59:16.573681 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Flavor pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:59:16.574074 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Image pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:59:16.574479 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:59:16.586588 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:16.587145 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:16.587681 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:16.588368 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:16.588810 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:16.589254 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:16.597664 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0217e07c-5e7a-4429-ba6e-ede54f7a17d2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:16.605673 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0217e07c-5e7a-4429-ba6e-ede54f7a17d2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1676 microversion: 2.1 time: 0.219404 Sep 11 00:59:16.606222 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 212/430] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:16 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:59:16.607119 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:59:16.611502 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for user 364cf4a7a3bf4e70973c78a5d690e998 and project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:59:16.623058 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Going to run 1 instances... {{(pid=120497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:59:16.625574 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:59:16.673806 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f51c5f80-cc4c-4a32-8db7-d4dc00768fa8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.678086 Sep 11 00:59:16.674451 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 219/431] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 00:59:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 00:59:16.685635 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b31009c1-f5b1-4bb4-ac35-d08f2cdb1dbe tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:16.686447 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b31009c1-f5b1-4bb4-ac35-d08f2cdb1dbe tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:16.741277 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b31009c1-f5b1-4bb4-ac35-d08f2cdb1dbe tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:16.748456 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b31009c1-f5b1-4bb4-ac35-d08f2cdb1dbe tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1240 microversion: 2.1 time: 0.066705 Sep 11 00:59:16.749108 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 213/432] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:16 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:16.955431 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-bc0c69ca-e06e-49ec-9d83-2741cbac7d1b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:16.956036 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-bc0c69ca-e06e-49ec-9d83-2741cbac7d1b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:16.962822 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bc0c69ca-e06e-49ec-9d83-2741cbac7d1b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:16.963341 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bc0c69ca-e06e-49ec-9d83-2741cbac7d1b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:16.963777 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bc0c69ca-e06e-49ec-9d83-2741cbac7d1b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:16.964497 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bc0c69ca-e06e-49ec-9d83-2741cbac7d1b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:16.964919 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bc0c69ca-e06e-49ec-9d83-2741cbac7d1b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:16.965331 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bc0c69ca-e06e-49ec-9d83-2741cbac7d1b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:17.095116 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-bc0c69ca-e06e-49ec-9d83-2741cbac7d1b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:17.102972 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-bc0c69ca-e06e-49ec-9d83-2741cbac7d1b tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1513 microversion: 2.1 time: 0.151767 Sep 11 00:59:17.103558 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 220/433] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:16 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:17.632982 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6ebc3593-7085-4e6e-b038-819f4110004d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:17.633982 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6ebc3593-7085-4e6e-b038-819f4110004d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:17.643210 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6ebc3593-7085-4e6e-b038-819f4110004d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:17.643710 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6ebc3593-7085-4e6e-b038-819f4110004d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:17.644142 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6ebc3593-7085-4e6e-b038-819f4110004d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:17.644829 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6ebc3593-7085-4e6e-b038-819f4110004d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:17.645283 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6ebc3593-7085-4e6e-b038-819f4110004d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:17.645715 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6ebc3593-7085-4e6e-b038-819f4110004d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:17.770335 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-90f62a0c-22a1-4cbf-a3ea-563030c09431 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:17.770939 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-90f62a0c-22a1-4cbf-a3ea-563030c09431 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:17.774924 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6ebc3593-7085-4e6e-b038-819f4110004d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:17.777693 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-90f62a0c-22a1-4cbf-a3ea-563030c09431 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:17.778236 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-90f62a0c-22a1-4cbf-a3ea-563030c09431 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:17.778902 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-90f62a0c-22a1-4cbf-a3ea-563030c09431 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:17.779639 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-90f62a0c-22a1-4cbf-a3ea-563030c09431 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:17.780077 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-90f62a0c-22a1-4cbf-a3ea-563030c09431 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:17.780630 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-90f62a0c-22a1-4cbf-a3ea-563030c09431 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:17.783035 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6ebc3593-7085-4e6e-b038-819f4110004d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1676 microversion: 2.1 time: 0.156575 Sep 11 00:59:17.783969 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 214/434] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:17 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:17.844542 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-90f62a0c-22a1-4cbf-a3ea-563030c09431 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:17.852430 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-90f62a0c-22a1-4cbf-a3ea-563030c09431 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1244 microversion: 2.1 time: 0.086258 Sep 11 00:59:17.852989 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 221/435] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:17 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:18.127674 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ac91a1f3-92ac-49e9-8352-cb1f0bfdfb4c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:18.128278 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ac91a1f3-92ac-49e9-8352-cb1f0bfdfb4c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:18.130225 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=6 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:18.135759 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac91a1f3-92ac-49e9-8352-cb1f0bfdfb4c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:18.136232 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac91a1f3-92ac-49e9-8352-cb1f0bfdfb4c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:18.136657 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac91a1f3-92ac-49e9-8352-cb1f0bfdfb4c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:18.137339 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac91a1f3-92ac-49e9-8352-cb1f0bfdfb4c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:18.137783 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac91a1f3-92ac-49e9-8352-cb1f0bfdfb4c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:18.138186 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac91a1f3-92ac-49e9-8352-cb1f0bfdfb4c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:18.276889 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-ac91a1f3-92ac-49e9-8352-cb1f0bfdfb4c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:18.290064 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ac91a1f3-92ac-49e9-8352-cb1f0bfdfb4c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1513 microversion: 2.1 time: 0.166715 Sep 11 00:59:18.290906 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 215/436] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:18 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:18.806932 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-9ebf17aa-d020-45e8-8ec9-153f6d3caefe tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:18.807542 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-9ebf17aa-d020-45e8-8ec9-153f6d3caefe tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:18.814578 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9ebf17aa-d020-45e8-8ec9-153f6d3caefe tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:18.815060 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9ebf17aa-d020-45e8-8ec9-153f6d3caefe tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:18.815512 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9ebf17aa-d020-45e8-8ec9-153f6d3caefe tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:18.816235 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9ebf17aa-d020-45e8-8ec9-153f6d3caefe tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:18.816687 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9ebf17aa-d020-45e8-8ec9-153f6d3caefe tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:18.817112 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9ebf17aa-d020-45e8-8ec9-153f6d3caefe tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:18.875706 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e4b50268-257e-49ba-ac71-04fe305acb06 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:18.876377 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e4b50268-257e-49ba-ac71-04fe305acb06 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:18.883490 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e4b50268-257e-49ba-ac71-04fe305acb06 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:18.883954 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e4b50268-257e-49ba-ac71-04fe305acb06 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:18.884380 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e4b50268-257e-49ba-ac71-04fe305acb06 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:18.885301 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e4b50268-257e-49ba-ac71-04fe305acb06 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:18.885911 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e4b50268-257e-49ba-ac71-04fe305acb06 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:18.886512 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e4b50268-257e-49ba-ac71-04fe305acb06 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:18.954625 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e4b50268-257e-49ba-ac71-04fe305acb06 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:18.962411 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e4b50268-257e-49ba-ac71-04fe305acb06 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1244 microversion: 2.1 time: 0.090589 Sep 11 00:59:18.962990 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 216/437] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:18 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:18.975705 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-9ebf17aa-d020-45e8-8ec9-153f6d3caefe tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:18.984003 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-9ebf17aa-d020-45e8-8ec9-153f6d3caefe tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1676 microversion: 2.1 time: 0.180931 Sep 11 00:59:18.984568 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 222/438] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:18 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:18.993001 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-de8f94bf-0645-4628-83c0-ed78e53a4db3 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcd0c282-d833-4270-960b-2089359ef810"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:18.995448 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-de8f94bf-0645-4628-83c0-ed78e53a4db3 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:19.003792 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-de8f94bf-0645-4628-83c0-ed78e53a4db3 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:19.004449 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-de8f94bf-0645-4628-83c0-ed78e53a4db3 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:19.004891 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-de8f94bf-0645-4628-83c0-ed78e53a4db3 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:19.005585 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-de8f94bf-0645-4628-83c0-ed78e53a4db3 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:19.006040 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-de8f94bf-0645-4628-83c0-ed78e53a4db3 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:19.006461 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-de8f94bf-0645-4628-83c0-ed78e53a4db3 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:19.080128 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:19.316141 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-53a2bfa4-742b-4cdc-bc8e-116c4b0aa908 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:19.316655 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-53a2bfa4-742b-4cdc-bc8e-116c4b0aa908 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:19.323151 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-53a2bfa4-742b-4cdc-bc8e-116c4b0aa908 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:19.323644 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-53a2bfa4-742b-4cdc-bc8e-116c4b0aa908 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:19.324079 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-53a2bfa4-742b-4cdc-bc8e-116c4b0aa908 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:19.324765 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-53a2bfa4-742b-4cdc-bc8e-116c4b0aa908 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:19.325207 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-53a2bfa4-742b-4cdc-bc8e-116c4b0aa908 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:19.325627 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-53a2bfa4-742b-4cdc-bc8e-116c4b0aa908 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:19.456509 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-53a2bfa4-742b-4cdc-bc8e-116c4b0aa908 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:19.464365 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-53a2bfa4-742b-4cdc-bc8e-116c4b0aa908 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1513 microversion: 2.1 time: 0.152281 Sep 11 00:59:19.464933 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 223/439] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:19 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:19.987561 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d1f7f8c5-6b63-47e1-bf85-f780a44f18e1 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:19.988193 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d1f7f8c5-6b63-47e1-bf85-f780a44f18e1 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:19.994871 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d1f7f8c5-6b63-47e1-bf85-f780a44f18e1 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:19.995377 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d1f7f8c5-6b63-47e1-bf85-f780a44f18e1 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:19.995801 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d1f7f8c5-6b63-47e1-bf85-f780a44f18e1 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:19.996481 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d1f7f8c5-6b63-47e1-bf85-f780a44f18e1 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:19.996923 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d1f7f8c5-6b63-47e1-bf85-f780a44f18e1 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:19.997334 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d1f7f8c5-6b63-47e1-bf85-f780a44f18e1 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:20.061268 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d1f7f8c5-6b63-47e1-bf85-f780a44f18e1 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:20.069265 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d1f7f8c5-6b63-47e1-bf85-f780a44f18e1 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1244 microversion: 2.1 time: 0.087117 Sep 11 00:59:20.069979 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 224/440] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:19 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:20.075402 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-57cc8a8a-4747-4076-b6ae-883b89693f46 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:20.076091 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-57cc8a8a-4747-4076-b6ae-883b89693f46 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:20.082688 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-57cc8a8a-4747-4076-b6ae-883b89693f46 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:20.084552 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-57cc8a8a-4747-4076-b6ae-883b89693f46 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:20.085245 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-57cc8a8a-4747-4076-b6ae-883b89693f46 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:20.085871 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-57cc8a8a-4747-4076-b6ae-883b89693f46 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:20.086323 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-57cc8a8a-4747-4076-b6ae-883b89693f46 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:20.086711 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-57cc8a8a-4747-4076-b6ae-883b89693f46 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:20.235286 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-57cc8a8a-4747-4076-b6ae-883b89693f46 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:20.243312 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-57cc8a8a-4747-4076-b6ae-883b89693f46 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1676 microversion: 2.1 time: 0.171485 Sep 11 00:59:20.243851 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 225/441] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:20 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:20.404740 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-de8f94bf-0645-4628-83c0-ed78e53a4db3 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "POST /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.415398 Sep 11 00:59:20.412469 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 217/442] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Sep 11 00:59:18 2022] POST /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-volume_attachments => generated 194 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:20.497071 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5c2fd40d-1198-421f-beb5-aef5c1439cb1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:20.497837 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-5c2fd40d-1198-421f-beb5-aef5c1439cb1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:20.505650 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5c2fd40d-1198-421f-beb5-aef5c1439cb1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:20.506125 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5c2fd40d-1198-421f-beb5-aef5c1439cb1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:20.506547 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5c2fd40d-1198-421f-beb5-aef5c1439cb1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:20.508431 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5c2fd40d-1198-421f-beb5-aef5c1439cb1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:20.510017 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5c2fd40d-1198-421f-beb5-aef5c1439cb1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:20.510452 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5c2fd40d-1198-421f-beb5-aef5c1439cb1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:20.654313 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-5c2fd40d-1198-421f-beb5-aef5c1439cb1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:20.663129 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-5c2fd40d-1198-421f-beb5-aef5c1439cb1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1513 microversion: 2.1 time: 0.172058 Sep 11 00:59:20.663664 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 226/443] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:20 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:59:20.808899 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-d5badb93-03fa-4603-bf44-1ba966c99271 req-cca4d08a-7638-40aa-8210-af1753b702ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84067194-1977-4b94-8372-f37a77fe546f", "name": "network-vif-deleted", "tag": "607691ae-ff58-42f0-b303-e48fad3480bb"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:20.819959 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d5badb93-03fa-4603-bf44-1ba966c99271 req-cca4d08a-7638-40aa-8210-af1753b702ea service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:20.820431 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d5badb93-03fa-4603-bf44-1ba966c99271 req-cca4d08a-7638-40aa-8210-af1753b702ea service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:20.820936 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d5badb93-03fa-4603-bf44-1ba966c99271 req-cca4d08a-7638-40aa-8210-af1753b702ea service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:20.833513 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-d5badb93-03fa-4603-bf44-1ba966c99271 req-cca4d08a-7638-40aa-8210-af1753b702ea service nova] Creating event network-vif-deleted:607691ae-ff58-42f0-b303-e48fad3480bb for instance 84067194-1977-4b94-8372-f37a77fe546f on hv-cinder-maste Sep 11 00:59:20.838419 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-d5badb93-03fa-4603-bf44-1ba966c99271 req-cca4d08a-7638-40aa-8210-af1753b702ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034691 Sep 11 00:59:20.839005 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 218/444] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:21.092160 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-1e7240d1-baa5-42b6-be13-cedbd5ae0f4c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:21.092793 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-1e7240d1-baa5-42b6-be13-cedbd5ae0f4c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:21.099870 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1e7240d1-baa5-42b6-be13-cedbd5ae0f4c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:21.100318 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1e7240d1-baa5-42b6-be13-cedbd5ae0f4c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:21.100728 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1e7240d1-baa5-42b6-be13-cedbd5ae0f4c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:21.101446 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1e7240d1-baa5-42b6-be13-cedbd5ae0f4c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:21.101892 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1e7240d1-baa5-42b6-be13-cedbd5ae0f4c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:21.102313 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1e7240d1-baa5-42b6-be13-cedbd5ae0f4c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:21.167572 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1e7240d1-baa5-42b6-be13-cedbd5ae0f4c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:21.177047 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-1e7240d1-baa5-42b6-be13-cedbd5ae0f4c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1292 microversion: 2.1 time: 0.088826 Sep 11 00:59:21.177744 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 227/445] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:21 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:21.269646 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b6d12828-5758-4838-b8bd-48819d2a75de tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:21.270383 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b6d12828-5758-4838-b8bd-48819d2a75de tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:21.277533 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b6d12828-5758-4838-b8bd-48819d2a75de tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:21.278033 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b6d12828-5758-4838-b8bd-48819d2a75de tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:21.278465 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b6d12828-5758-4838-b8bd-48819d2a75de tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:21.279142 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b6d12828-5758-4838-b8bd-48819d2a75de tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:21.279615 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b6d12828-5758-4838-b8bd-48819d2a75de tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:21.280026 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b6d12828-5758-4838-b8bd-48819d2a75de tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:21.420212 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b6d12828-5758-4838-b8bd-48819d2a75de tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:21.429343 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b6d12828-5758-4838-b8bd-48819d2a75de tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1676 microversion: 2.1 time: 0.164035 Sep 11 00:59:21.429958 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 219/446] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:21 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:21.688717 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3e1f5919-7ece-4882-8086-d1875197dd61 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:21.689322 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3e1f5919-7ece-4882-8086-d1875197dd61 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:21.695414 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e1f5919-7ece-4882-8086-d1875197dd61 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:21.695900 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e1f5919-7ece-4882-8086-d1875197dd61 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:21.696334 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e1f5919-7ece-4882-8086-d1875197dd61 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:21.697025 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e1f5919-7ece-4882-8086-d1875197dd61 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:21.697458 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e1f5919-7ece-4882-8086-d1875197dd61 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:21.697888 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e1f5919-7ece-4882-8086-d1875197dd61 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:21.732203 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e1f5919-7ece-4882-8086-d1875197dd61 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:21.732680 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e1f5919-7ece-4882-8086-d1875197dd61 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:21.733107 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e1f5919-7ece-4882-8086-d1875197dd61 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:21.733547 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-3e1f5919-7ece-4882-8086-d1875197dd61 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lazy-loading 'fault' on Instance uuid 84067194-1977-4b94-8372-f37a77fe546f {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:59:21.774206 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3e1f5919-7ece-4882-8086-d1875197dd61 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:21.781967 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3e1f5919-7ece-4882-8086-d1875197dd61 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1308 microversion: 2.1 time: 0.097192 Sep 11 00:59:21.782612 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 228/447] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:21 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:22.206204 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-15158107-06a8-4c86-b23d-1a9a4c59750e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:22.207206 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-15158107-06a8-4c86-b23d-1a9a4c59750e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:22.210650 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:22.230840 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15158107-06a8-4c86-b23d-1a9a4c59750e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:22.231457 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15158107-06a8-4c86-b23d-1a9a4c59750e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:22.231966 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15158107-06a8-4c86-b23d-1a9a4c59750e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:22.238035 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15158107-06a8-4c86-b23d-1a9a4c59750e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:22.238611 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15158107-06a8-4c86-b23d-1a9a4c59750e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:22.239112 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-15158107-06a8-4c86-b23d-1a9a4c59750e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:22.309874 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-15158107-06a8-4c86-b23d-1a9a4c59750e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:22.317843 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-15158107-06a8-4c86-b23d-1a9a4c59750e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1310 microversion: 2.1 time: 0.118467 Sep 11 00:59:22.318430 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 220/448] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:22 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1310 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:22.460868 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f0f1a9eb-f956-48cf-b41d-b54384369167 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:22.461468 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f0f1a9eb-f956-48cf-b41d-b54384369167 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:22.468139 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f0f1a9eb-f956-48cf-b41d-b54384369167 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:22.468616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f0f1a9eb-f956-48cf-b41d-b54384369167 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:22.469043 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f0f1a9eb-f956-48cf-b41d-b54384369167 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:22.469726 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f0f1a9eb-f956-48cf-b41d-b54384369167 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:22.470197 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f0f1a9eb-f956-48cf-b41d-b54384369167 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:22.470647 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f0f1a9eb-f956-48cf-b41d-b54384369167 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:22.633341 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f0f1a9eb-f956-48cf-b41d-b54384369167 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:22.642021 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f0f1a9eb-f956-48cf-b41d-b54384369167 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1676 microversion: 2.1 time: 0.184996 Sep 11 00:59:22.642775 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 229/449] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:22 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:22.685643 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-17dd2722-c08b-4d0f-9188-d19f81ffef28 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:22.689272 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-17dd2722-c08b-4d0f-9188-d19f81ffef28 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:22.695831 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17dd2722-c08b-4d0f-9188-d19f81ffef28 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:22.696446 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17dd2722-c08b-4d0f-9188-d19f81ffef28 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:22.696880 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17dd2722-c08b-4d0f-9188-d19f81ffef28 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:22.697603 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17dd2722-c08b-4d0f-9188-d19f81ffef28 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:22.698073 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17dd2722-c08b-4d0f-9188-d19f81ffef28 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:22.698452 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17dd2722-c08b-4d0f-9188-d19f81ffef28 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:22.726183 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-17dd2722-c08b-4d0f-9188-d19f81ffef28 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lazy-loading 'flavor' on Instance uuid 56cf74eb-5098-47e8-b99c-efd0af892b66 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:59:22.805482 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-bdcf0ca3-8a17-444b-b1e0-dc5ae15e10ef tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:22.806812 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-bdcf0ca3-8a17-444b-b1e0-dc5ae15e10ef tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:22.812855 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdcf0ca3-8a17-444b-b1e0-dc5ae15e10ef tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:22.813463 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdcf0ca3-8a17-444b-b1e0-dc5ae15e10ef tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:22.814049 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdcf0ca3-8a17-444b-b1e0-dc5ae15e10ef tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:22.814826 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdcf0ca3-8a17-444b-b1e0-dc5ae15e10ef tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:22.815422 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdcf0ca3-8a17-444b-b1e0-dc5ae15e10ef tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:22.815901 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdcf0ca3-8a17-444b-b1e0-dc5ae15e10ef tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:22.847967 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdcf0ca3-8a17-444b-b1e0-dc5ae15e10ef tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:22.848470 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdcf0ca3-8a17-444b-b1e0-dc5ae15e10ef tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:22.848988 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bdcf0ca3-8a17-444b-b1e0-dc5ae15e10ef tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:22.849502 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-bdcf0ca3-8a17-444b-b1e0-dc5ae15e10ef tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lazy-loading 'fault' on Instance uuid 84067194-1977-4b94-8372-f37a77fe546f {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:59:22.869889 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-17dd2722-c08b-4d0f-9188-d19f81ffef28 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "POST /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/action" status: 200 len: 32 microversion: 2.1 time: 0.189277 Sep 11 00:59:22.874731 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 221/450] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Sep 11 00:59:22 2022] POST /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:59:22.880971 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c6c8de14-ba38-4183-8fd1-115f6fb9fd4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:22.881693 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c6c8de14-ba38-4183-8fd1-115f6fb9fd4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:22.887899 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6c8de14-ba38-4183-8fd1-115f6fb9fd4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:22.888411 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6c8de14-ba38-4183-8fd1-115f6fb9fd4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:22.888823 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6c8de14-ba38-4183-8fd1-115f6fb9fd4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:22.889709 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6c8de14-ba38-4183-8fd1-115f6fb9fd4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:22.890159 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6c8de14-ba38-4183-8fd1-115f6fb9fd4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:22.890585 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6c8de14-ba38-4183-8fd1-115f6fb9fd4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:22.896193 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-bdcf0ca3-8a17-444b-b1e0-dc5ae15e10ef tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:22.906823 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-bdcf0ca3-8a17-444b-b1e0-dc5ae15e10ef tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 200 len: 1308 microversion: 2.1 time: 0.104903 Sep 11 00:59:22.907648 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 230/451] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:22 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:59:23.037746 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c6c8de14-ba38-4183-8fd1-115f6fb9fd4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:23.048004 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c6c8de14-ba38-4183-8fd1-115f6fb9fd4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.171115 Sep 11 00:59:23.063307 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 222/452] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:22 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:59:23.341246 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ac470790-e36f-4b1f-ac25-411cb0de911e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:23.341860 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ac470790-e36f-4b1f-ac25-411cb0de911e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:23.348199 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac470790-e36f-4b1f-ac25-411cb0de911e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:23.348686 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac470790-e36f-4b1f-ac25-411cb0de911e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:23.349117 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac470790-e36f-4b1f-ac25-411cb0de911e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:23.349800 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac470790-e36f-4b1f-ac25-411cb0de911e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:23.350244 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac470790-e36f-4b1f-ac25-411cb0de911e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:23.350659 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ac470790-e36f-4b1f-ac25-411cb0de911e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:23.675598 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-10f0a6f3-6633-41e9-909a-74928ffb59c5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:23.676737 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-10f0a6f3-6633-41e9-909a-74928ffb59c5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:23.685530 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-10f0a6f3-6633-41e9-909a-74928ffb59c5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:23.686004 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-10f0a6f3-6633-41e9-909a-74928ffb59c5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:23.686615 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-10f0a6f3-6633-41e9-909a-74928ffb59c5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:23.687130 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-10f0a6f3-6633-41e9-909a-74928ffb59c5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:23.687643 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-10f0a6f3-6633-41e9-909a-74928ffb59c5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:23.688031 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-10f0a6f3-6633-41e9-909a-74928ffb59c5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:23.850897 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ac470790-e36f-4b1f-ac25-411cb0de911e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:23.859647 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ac470790-e36f-4b1f-ac25-411cb0de911e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1366 microversion: 2.1 time: 0.522320 Sep 11 00:59:23.860345 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 231/453] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:23 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:23.930856 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-909b275f-0889-4a54-84ad-f22a9057f5ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:23.932818 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-909b275f-0889-4a54-84ad-f22a9057f5ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: 84067194-1977-4b94-8372-f37a77fe546f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:23.939220 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-909b275f-0889-4a54-84ad-f22a9057f5ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:23.939815 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-909b275f-0889-4a54-84ad-f22a9057f5ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:23.940364 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-909b275f-0889-4a54-84ad-f22a9057f5ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:23.941277 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-909b275f-0889-4a54-84ad-f22a9057f5ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:23.941895 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-909b275f-0889-4a54-84ad-f22a9057f5ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:23.942570 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-909b275f-0889-4a54-84ad-f22a9057f5ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:23.958172 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-909b275f-0889-4a54-84ad-f22a9057f5ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] HTTP exception thrown: Instance 84067194-1977-4b94-8372-f37a77fe546f could not be found. Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-909b275f-0889-4a54-84ad-f22a9057f5ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Request method failure captured: Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f HTTP/1.1 Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTKTI3IO_Ig3NlC3G2JsEkmLnAcV_BgBNUv7gCuBRb7Hz_qusXQaq_kWgf1pb1lKjJHYxKw3qPW660n42--hLRmVd_Yzps0YXqBTxBHbA_0cE0rIfxLilEKBf377zjXCcWA9cz2l9PFYtmn0-4tKiz4FiWZjNd9azeultBAMUaMtxaw Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 20163c9fb6a5490f9ad676ac84fe411b Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1219202710 Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 00:59:23.959970 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 00:59:23.961281 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20163c9fb6a5490f9ad676ac84fe411b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20163c9fb6a5490f9ad676ac84fe411b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20163c9fb6a5490f9ad676ac84fe411b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20163c9fb6a5490f9ad676ac84fe411b", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:59:23.961281 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-VolumesSnapshotTestJSON-1219202710 Sep 11 00:59:23.961281 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 20163c9fb6a5490f9ad676ac84fe411b Sep 11 00:59:23.961281 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1219202710 Sep 11 00:59:23.961281 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-VolumesSnapshotTestJSON-1219202710-project Sep 11 00:59:23.961281 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 00:59:23.961281 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 00:59:23.961281 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 6ca9626cd8bd4341ba7d26e76f34b533 Sep 11 00:59:23.961281 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-VolumesSnapshotTestJSON-1219202710-project Sep 11 00:59:23.961281 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 00:59:23.961281 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance 84067194-1977-4b94-8372-f37a77fe546f could not be found. Sep 11 00:59:23.961281 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': '84067194-1977-4b94-8372-f37a77fe546f'} Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84067194-1977-4b94-8372-f37a77fe546f could not be found. Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:59:23.967256 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84067194-1977-4b94-8372-f37a77fe546f could not be found. Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84067194-1977-4b94-8372-f37a77fe546f could not be found. Sep 11 00:59:23.968471 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 00:59:23.969551 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-909b275f-0889-4a54-84ad-f22a9057f5ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Returning 404 to user: Instance 84067194-1977-4b94-8372-f37a77fe546f could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:59:23.969551 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-909b275f-0889-4a54-84ad-f22a9057f5ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f" status: 404 len: 111 microversion: 2.1 time: 0.034708 Sep 11 00:59:23.969551 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 232/454] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:23 2022] GET /compute/v2.1/servers/84067194-1977-4b94-8372-f37a77fe546f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 00:59:24.014646 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-10f0a6f3-6633-41e9-909a-74928ffb59c5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:24.028608 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-10f0a6f3-6633-41e9-909a-74928ffb59c5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1653 microversion: 2.1 time: 0.357990 Sep 11 00:59:24.029202 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 223/455] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:23 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1653 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:24.052234 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-fa38de41-0be0-4cb4-b91f-a88037ed983a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:24.059476 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa38de41-0be0-4cb4-b91f-a88037ed983a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:24.060179 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa38de41-0be0-4cb4-b91f-a88037ed983a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:24.060605 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa38de41-0be0-4cb4-b91f-a88037ed983a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:24.067110 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-c4857c04-16a2-4530-af92-a1301329fd0c req-374cc825-fe80-43c2-98f1-23fae42f13fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68ba728f-6c2a-4a9c-8f55-d87c0046b7b1", "tag": "70298aae-6b4c-46bf-9ebc-8c03965f50cf"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:24.085660 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c4857c04-16a2-4530-af92-a1301329fd0c req-374cc825-fe80-43c2-98f1-23fae42f13fa service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:24.089039 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c4857c04-16a2-4530-af92-a1301329fd0c req-374cc825-fe80-43c2-98f1-23fae42f13fa service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:24.090635 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c4857c04-16a2-4530-af92-a1301329fd0c req-374cc825-fe80-43c2-98f1-23fae42f13fa service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:24.092487 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-fa38de41-0be0-4cb4-b91f-a88037ed983a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Going to try to start instance {{(pid=120497) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 11 00:59:24.114707 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:24.124401 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-c4857c04-16a2-4530-af92-a1301329fd0c req-374cc825-fe80-43c2-98f1-23fae42f13fa service nova] Creating event network-changed:70298aae-6b4c-46bf-9ebc-8c03965f50cf for instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 on hv-cinder-maste Sep 11 00:59:24.136328 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-c4857c04-16a2-4530-af92-a1301329fd0c req-374cc825-fe80-43c2-98f1-23fae42f13fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074196 Sep 11 00:59:24.137701 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 224/456] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:24.143856 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e7e1be9a-ef70-4f6d-8fc4-48e9a568e76e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:24.144814 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e7e1be9a-ef70-4f6d-8fc4-48e9a568e76e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:24.152064 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7e1be9a-ef70-4f6d-8fc4-48e9a568e76e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:24.153008 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7e1be9a-ef70-4f6d-8fc4-48e9a568e76e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:24.153651 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7e1be9a-ef70-4f6d-8fc4-48e9a568e76e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:24.154586 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7e1be9a-ef70-4f6d-8fc4-48e9a568e76e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:24.155381 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7e1be9a-ef70-4f6d-8fc4-48e9a568e76e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:24.156204 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7e1be9a-ef70-4f6d-8fc4-48e9a568e76e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:24.184022 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-fa38de41-0be0-4cb4-b91f-a88037ed983a tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "POST /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/action" status: 202 len: 0 microversion: 2.1 time: 0.136010 Sep 11 00:59:24.185775 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 233/457] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Sep 11 00:59:24 2022] POST /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 00:59:24.194712 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-bfd4a1ea-dd40-4b95-9276-2ee71eaacf03 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:24.195888 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-bfd4a1ea-dd40-4b95-9276-2ee71eaacf03 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:24.204819 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bfd4a1ea-dd40-4b95-9276-2ee71eaacf03 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:24.205319 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bfd4a1ea-dd40-4b95-9276-2ee71eaacf03 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:24.206111 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bfd4a1ea-dd40-4b95-9276-2ee71eaacf03 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:24.207227 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bfd4a1ea-dd40-4b95-9276-2ee71eaacf03 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:24.207848 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bfd4a1ea-dd40-4b95-9276-2ee71eaacf03 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:24.208979 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bfd4a1ea-dd40-4b95-9276-2ee71eaacf03 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:24.411401 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e7e1be9a-ef70-4f6d-8fc4-48e9a568e76e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:24.422441 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e7e1be9a-ef70-4f6d-8fc4-48e9a568e76e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.282985 Sep 11 00:59:24.423543 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 225/458] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:24 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:24.487204 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-bfd4a1ea-dd40-4b95-9276-2ee71eaacf03 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:24.495499 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-bfd4a1ea-dd40-4b95-9276-2ee71eaacf03 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1662 microversion: 2.1 time: 0.306025 Sep 11 00:59:24.496067 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 234/459] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:24 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1662 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:24.882857 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4c4badee-f493-4464-936a-b92bc4eb23dd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:24.883473 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4c4badee-f493-4464-936a-b92bc4eb23dd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:24.889989 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c4badee-f493-4464-936a-b92bc4eb23dd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:24.890458 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c4badee-f493-4464-936a-b92bc4eb23dd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:24.890878 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c4badee-f493-4464-936a-b92bc4eb23dd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:24.891658 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c4badee-f493-4464-936a-b92bc4eb23dd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:24.892100 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c4badee-f493-4464-936a-b92bc4eb23dd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:24.892503 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c4badee-f493-4464-936a-b92bc4eb23dd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:25.030226 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4c4badee-f493-4464-936a-b92bc4eb23dd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:25.038054 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4c4badee-f493-4464-936a-b92bc4eb23dd tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1366 microversion: 2.1 time: 0.159271 Sep 11 00:59:25.038632 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 226/460] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:24 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:25.446149 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a1056cd9-72c1-4508-a0a6-37759b93100e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:25.446820 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a1056cd9-72c1-4508-a0a6-37759b93100e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:25.453474 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1056cd9-72c1-4508-a0a6-37759b93100e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:25.453967 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1056cd9-72c1-4508-a0a6-37759b93100e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:25.454398 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1056cd9-72c1-4508-a0a6-37759b93100e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:25.455080 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1056cd9-72c1-4508-a0a6-37759b93100e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:25.455551 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1056cd9-72c1-4508-a0a6-37759b93100e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:25.455966 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1056cd9-72c1-4508-a0a6-37759b93100e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:25.518245 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3057f760-2053-4b5d-9fd3-afe937e74d5d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:25.518862 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3057f760-2053-4b5d-9fd3-afe937e74d5d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:25.525307 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3057f760-2053-4b5d-9fd3-afe937e74d5d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:25.525763 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3057f760-2053-4b5d-9fd3-afe937e74d5d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:25.526237 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3057f760-2053-4b5d-9fd3-afe937e74d5d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:25.526930 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3057f760-2053-4b5d-9fd3-afe937e74d5d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:25.527420 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3057f760-2053-4b5d-9fd3-afe937e74d5d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:25.527842 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3057f760-2053-4b5d-9fd3-afe937e74d5d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:25.629956 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a1056cd9-72c1-4508-a0a6-37759b93100e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:25.638667 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a1056cd9-72c1-4508-a0a6-37759b93100e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.196378 Sep 11 00:59:25.639249 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 235/461] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:25 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:25.694051 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3057f760-2053-4b5d-9fd3-afe937e74d5d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:25.702070 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3057f760-2053-4b5d-9fd3-afe937e74d5d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1662 microversion: 2.1 time: 0.187893 Sep 11 00:59:25.702731 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 227/462] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:25 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1662 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:59:26.061508 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-34ad30a9-c619-4441-a0ca-30ea85033bf0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:26.062093 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-34ad30a9-c619-4441-a0ca-30ea85033bf0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:26.068473 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-34ad30a9-c619-4441-a0ca-30ea85033bf0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:26.068958 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-34ad30a9-c619-4441-a0ca-30ea85033bf0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:26.069388 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-34ad30a9-c619-4441-a0ca-30ea85033bf0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:26.070078 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-34ad30a9-c619-4441-a0ca-30ea85033bf0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:26.070530 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-34ad30a9-c619-4441-a0ca-30ea85033bf0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:26.070948 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-34ad30a9-c619-4441-a0ca-30ea85033bf0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:26.209544 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-34ad30a9-c619-4441-a0ca-30ea85033bf0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:26.217310 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-34ad30a9-c619-4441-a0ca-30ea85033bf0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1366 microversion: 2.1 time: 0.159838 Sep 11 00:59:26.217950 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 236/463] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:26 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:26.667297 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d92676af-6989-467b-af4a-0b9965dcd851 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:26.668378 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d92676af-6989-467b-af4a-0b9965dcd851 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:26.676484 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d92676af-6989-467b-af4a-0b9965dcd851 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:26.676977 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d92676af-6989-467b-af4a-0b9965dcd851 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:26.677410 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d92676af-6989-467b-af4a-0b9965dcd851 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:26.678134 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d92676af-6989-467b-af4a-0b9965dcd851 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:26.678585 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d92676af-6989-467b-af4a-0b9965dcd851 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:26.679007 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d92676af-6989-467b-af4a-0b9965dcd851 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:26.726426 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-967554c0-0e75-4097-a5ed-6118bc740f10 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:26.726971 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-967554c0-0e75-4097-a5ed-6118bc740f10 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:26.729333 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=2 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:26.729968 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=6 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:26.737650 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-967554c0-0e75-4097-a5ed-6118bc740f10 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:26.738152 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-967554c0-0e75-4097-a5ed-6118bc740f10 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:26.738560 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-967554c0-0e75-4097-a5ed-6118bc740f10 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:26.739518 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-967554c0-0e75-4097-a5ed-6118bc740f10 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:26.740164 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-967554c0-0e75-4097-a5ed-6118bc740f10 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:26.740596 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-967554c0-0e75-4097-a5ed-6118bc740f10 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:26.746388 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=6 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:26.860497 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-d92676af-6989-467b-af4a-0b9965dcd851 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:26.869029 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d92676af-6989-467b-af4a-0b9965dcd851 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.207123 Sep 11 00:59:26.869569 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 228/464] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:26 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:26.918304 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-967554c0-0e75-4097-a5ed-6118bc740f10 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:26.926632 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-967554c0-0e75-4097-a5ed-6118bc740f10 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1662 microversion: 2.1 time: 0.204319 Sep 11 00:59:26.927203 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 237/465] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:26 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1662 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:27.242288 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3ddc2366-47dd-49f6-9bc7-dea32650f437 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:27.242904 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3ddc2366-47dd-49f6-9bc7-dea32650f437 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:27.249328 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3ddc2366-47dd-49f6-9bc7-dea32650f437 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:27.249811 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3ddc2366-47dd-49f6-9bc7-dea32650f437 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:27.250245 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3ddc2366-47dd-49f6-9bc7-dea32650f437 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:27.250942 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3ddc2366-47dd-49f6-9bc7-dea32650f437 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:27.251420 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3ddc2366-47dd-49f6-9bc7-dea32650f437 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:27.251843 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3ddc2366-47dd-49f6-9bc7-dea32650f437 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:27.381544 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3ddc2366-47dd-49f6-9bc7-dea32650f437 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:27.389578 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3ddc2366-47dd-49f6-9bc7-dea32650f437 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1366 microversion: 2.1 time: 0.151503 Sep 11 00:59:27.394958 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 229/466] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:27 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:27.893401 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-9aa248e4-6f8f-43c2-abc0-525d50bec617 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:27.894102 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-9aa248e4-6f8f-43c2-abc0-525d50bec617 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:27.900771 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9aa248e4-6f8f-43c2-abc0-525d50bec617 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:27.901247 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9aa248e4-6f8f-43c2-abc0-525d50bec617 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:27.901672 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9aa248e4-6f8f-43c2-abc0-525d50bec617 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:27.902360 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9aa248e4-6f8f-43c2-abc0-525d50bec617 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:27.902804 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9aa248e4-6f8f-43c2-abc0-525d50bec617 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:27.903266 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9aa248e4-6f8f-43c2-abc0-525d50bec617 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:27.922402 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-613529210", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "networks": [{"uuid": "166d9243-0d0d-4778-89ab-03cbc34d3928"}]}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:27.977761 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] validate_networks() for [('166d9243-0d0d-4778-89ab-03cbc34d3928', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:59:28.104239 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-9aa248e4-6f8f-43c2-abc0-525d50bec617 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:28.113437 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-9aa248e4-6f8f-43c2-abc0-525d50bec617 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.223833 Sep 11 00:59:28.114111 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 238/467] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:27 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:28.118696 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-303c5abb-b2b0-4de3-a55e-61e152d87b74 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:28.119332 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-303c5abb-b2b0-4de3-a55e-61e152d87b74 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:28.125827 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-303c5abb-b2b0-4de3-a55e-61e152d87b74 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:28.126355 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-303c5abb-b2b0-4de3-a55e-61e152d87b74 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:28.126877 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-303c5abb-b2b0-4de3-a55e-61e152d87b74 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:28.127703 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-303c5abb-b2b0-4de3-a55e-61e152d87b74 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:28.128199 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-303c5abb-b2b0-4de3-a55e-61e152d87b74 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:28.128666 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-303c5abb-b2b0-4de3-a55e-61e152d87b74 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:28.352052 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-303c5abb-b2b0-4de3-a55e-61e152d87b74 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:28.365326 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-303c5abb-b2b0-4de3-a55e-61e152d87b74 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1666 microversion: 2.1 time: 0.249954 Sep 11 00:59:28.366184 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 239/468] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:28 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1666 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:28.413453 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5a585989-674b-4e8c-8d8f-56083ccc0982 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:28.414755 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-5a585989-674b-4e8c-8d8f-56083ccc0982 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:28.426973 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5a585989-674b-4e8c-8d8f-56083ccc0982 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:28.427501 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5a585989-674b-4e8c-8d8f-56083ccc0982 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:28.427933 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5a585989-674b-4e8c-8d8f-56083ccc0982 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:28.428668 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5a585989-674b-4e8c-8d8f-56083ccc0982 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:28.429117 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5a585989-674b-4e8c-8d8f-56083ccc0982 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:28.429534 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5a585989-674b-4e8c-8d8f-56083ccc0982 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:28.437626 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:59:28.438055 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:59:28.438528 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:59:28.438929 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:59:28.439377 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:59:28.448644 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:28.449124 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:28.449557 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:28.450284 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:28.450736 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:28.451162 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:28.468393 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Getting quotas for project 20163c9fb6a5490f9ad676ac84fe411b. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:59:28.472478 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Getting quotas for user 6ca9626cd8bd4341ba7d26e76f34b533 and project 20163c9fb6a5490f9ad676ac84fe411b. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:59:28.484195 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:59:28.486565 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:59:28.534027 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1742f875-34c5-4519-9358-72ab927b576c tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615268 Sep 11 00:59:28.535012 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 230/469] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 00:59:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 00:59:28.546535 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2d85bf70-506a-4531-bd4f-04810f0280f8 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:28.547245 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2d85bf70-506a-4531-bd4f-04810f0280f8 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:28.590075 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-5a585989-674b-4e8c-8d8f-56083ccc0982 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:28.598247 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-5a585989-674b-4e8c-8d8f-56083ccc0982 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1366 microversion: 2.1 time: 0.188740 Sep 11 00:59:28.611212 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 240/470] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:28 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:28.611652 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-2d85bf70-506a-4531-bd4f-04810f0280f8 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:28.615153 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2d85bf70-506a-4531-bd4f-04810f0280f8 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1218 microversion: 2.1 time: 0.072724 Sep 11 00:59:28.616081 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 231/471] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:28 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:59:29.138064 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3c67bc33-e515-4154-afb3-b29725f8d6f4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:29.139216 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3c67bc33-e515-4154-afb3-b29725f8d6f4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:29.145996 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c67bc33-e515-4154-afb3-b29725f8d6f4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:29.146697 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c67bc33-e515-4154-afb3-b29725f8d6f4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:29.147317 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c67bc33-e515-4154-afb3-b29725f8d6f4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:29.148202 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c67bc33-e515-4154-afb3-b29725f8d6f4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:29.148803 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c67bc33-e515-4154-afb3-b29725f8d6f4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:29.149368 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c67bc33-e515-4154-afb3-b29725f8d6f4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:29.292171 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3c67bc33-e515-4154-afb3-b29725f8d6f4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:29.302349 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3c67bc33-e515-4154-afb3-b29725f8d6f4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.167999 Sep 11 00:59:29.303468 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 241/472] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:29 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:29.309954 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-2ce852aa-cca1-4679-83d9-e4cb4458b342 req-54bb84d6-a81a-4f3f-bb19-aa9033a977cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ba728f-6c2a-4a9c-8f55-d87c0046b7b1", "name": "network-vif-plugged", "status": "completed", "tag": "70298aae-6b4c-46bf-9ebc-8c03965f50cf"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:29.327978 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-2ce852aa-cca1-4679-83d9-e4cb4458b342 req-54bb84d6-a81a-4f3f-bb19-aa9033a977cb service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:29.328462 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-2ce852aa-cca1-4679-83d9-e4cb4458b342 req-54bb84d6-a81a-4f3f-bb19-aa9033a977cb service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:29.328890 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-2ce852aa-cca1-4679-83d9-e4cb4458b342 req-54bb84d6-a81a-4f3f-bb19-aa9033a977cb service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:29.340797 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-2ce852aa-cca1-4679-83d9-e4cb4458b342 req-54bb84d6-a81a-4f3f-bb19-aa9033a977cb service nova] Creating event network-vif-plugged:70298aae-6b4c-46bf-9ebc-8c03965f50cf for instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 on hv-cinder-maste Sep 11 00:59:29.346403 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-2ce852aa-cca1-4679-83d9-e4cb4458b342 req-54bb84d6-a81a-4f3f-bb19-aa9033a977cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046013 Sep 11 00:59:29.347110 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 232/473] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:29.622833 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e20bb23e-e454-4448-b743-66a2311b7e33 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:29.623467 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-e20bb23e-e454-4448-b743-66a2311b7e33 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:29.629909 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e20bb23e-e454-4448-b743-66a2311b7e33 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:29.630397 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e20bb23e-e454-4448-b743-66a2311b7e33 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:29.630816 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e20bb23e-e454-4448-b743-66a2311b7e33 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:29.631532 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e20bb23e-e454-4448-b743-66a2311b7e33 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:29.632095 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e20bb23e-e454-4448-b743-66a2311b7e33 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:29.632610 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e20bb23e-e454-4448-b743-66a2311b7e33 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:29.638072 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a326a0aa-aa55-4cdb-b115-2ada29b4bc93 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:29.638855 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a326a0aa-aa55-4cdb-b115-2ada29b4bc93 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:29.645378 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a326a0aa-aa55-4cdb-b115-2ada29b4bc93 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:29.645880 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a326a0aa-aa55-4cdb-b115-2ada29b4bc93 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:29.646307 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a326a0aa-aa55-4cdb-b115-2ada29b4bc93 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:29.646989 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a326a0aa-aa55-4cdb-b115-2ada29b4bc93 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:29.647467 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a326a0aa-aa55-4cdb-b115-2ada29b4bc93 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:29.647884 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a326a0aa-aa55-4cdb-b115-2ada29b4bc93 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:29.732621 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a326a0aa-aa55-4cdb-b115-2ada29b4bc93 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:29.740871 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a326a0aa-aa55-4cdb-b115-2ada29b4bc93 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1270 microversion: 2.1 time: 0.106969 Sep 11 00:59:29.741660 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 233/474] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:29 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:29.789373 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-e20bb23e-e454-4448-b743-66a2311b7e33 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:29.798123 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-e20bb23e-e454-4448-b743-66a2311b7e33 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1366 microversion: 2.1 time: 0.179190 Sep 11 00:59:29.798698 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 242/475] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:29 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:30.326148 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-18bb577c-0b2a-4ee3-ba93-909dc11570db tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:30.326721 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-18bb577c-0b2a-4ee3-ba93-909dc11570db tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:30.333716 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-18bb577c-0b2a-4ee3-ba93-909dc11570db tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:30.334201 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-18bb577c-0b2a-4ee3-ba93-909dc11570db tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:30.334641 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-18bb577c-0b2a-4ee3-ba93-909dc11570db tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:30.335369 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-18bb577c-0b2a-4ee3-ba93-909dc11570db tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:30.335820 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-18bb577c-0b2a-4ee3-ba93-909dc11570db tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:30.336245 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-18bb577c-0b2a-4ee3-ba93-909dc11570db tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:30.480447 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-18bb577c-0b2a-4ee3-ba93-909dc11570db tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:30.482782 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:30.490673 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-18bb577c-0b2a-4ee3-ba93-909dc11570db tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.168622 Sep 11 00:59:30.491256 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 234/476] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:30 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:30.764082 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-08ad1700-0813-4911-b55b-11486b7d336d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:30.764761 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-08ad1700-0813-4911-b55b-11486b7d336d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:30.771487 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08ad1700-0813-4911-b55b-11486b7d336d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:30.772132 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08ad1700-0813-4911-b55b-11486b7d336d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:30.772657 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08ad1700-0813-4911-b55b-11486b7d336d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:30.773823 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08ad1700-0813-4911-b55b-11486b7d336d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:30.774295 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08ad1700-0813-4911-b55b-11486b7d336d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:30.774716 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08ad1700-0813-4911-b55b-11486b7d336d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:30.822885 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ebc4a29f-1103-4bfd-8d19-99b8e55c7379 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:30.823103 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ebc4a29f-1103-4bfd-8d19-99b8e55c7379 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:30.829839 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ebc4a29f-1103-4bfd-8d19-99b8e55c7379 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:30.830338 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ebc4a29f-1103-4bfd-8d19-99b8e55c7379 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:30.830776 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ebc4a29f-1103-4bfd-8d19-99b8e55c7379 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:30.831532 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ebc4a29f-1103-4bfd-8d19-99b8e55c7379 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:30.831989 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ebc4a29f-1103-4bfd-8d19-99b8e55c7379 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:30.832413 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ebc4a29f-1103-4bfd-8d19-99b8e55c7379 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:30.852138 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-08ad1700-0813-4911-b55b-11486b7d336d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:30.860285 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-08ad1700-0813-4911-b55b-11486b7d336d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1276 microversion: 2.1 time: 0.100854 Sep 11 00:59:30.861048 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 243/477] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:30 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1276 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:30.970208 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-ebc4a29f-1103-4bfd-8d19-99b8e55c7379 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:30.978144 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ebc4a29f-1103-4bfd-8d19-99b8e55c7379 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1366 microversion: 2.1 time: 0.159970 Sep 11 00:59:30.978704 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 235/478] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:30 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:31.515095 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f23bd78d-58ed-40f2-9f83-734fd8c803e6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:31.515814 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f23bd78d-58ed-40f2-9f83-734fd8c803e6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:31.522989 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f23bd78d-58ed-40f2-9f83-734fd8c803e6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:31.523572 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f23bd78d-58ed-40f2-9f83-734fd8c803e6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:31.524061 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f23bd78d-58ed-40f2-9f83-734fd8c803e6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:31.524910 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f23bd78d-58ed-40f2-9f83-734fd8c803e6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:31.525421 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f23bd78d-58ed-40f2-9f83-734fd8c803e6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:31.525898 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f23bd78d-58ed-40f2-9f83-734fd8c803e6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:31.661248 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f23bd78d-58ed-40f2-9f83-734fd8c803e6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:31.670121 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f23bd78d-58ed-40f2-9f83-734fd8c803e6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.159431 Sep 11 00:59:31.670883 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 244/479] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:31 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:31.883475 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-145148d2-41ff-4a25-bc3e-d741e6db16f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:31.884024 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-145148d2-41ff-4a25-bc3e-d741e6db16f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:31.890776 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-145148d2-41ff-4a25-bc3e-d741e6db16f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:31.891372 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-145148d2-41ff-4a25-bc3e-d741e6db16f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:31.891765 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-145148d2-41ff-4a25-bc3e-d741e6db16f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:31.892542 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-145148d2-41ff-4a25-bc3e-d741e6db16f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:31.892994 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-145148d2-41ff-4a25-bc3e-d741e6db16f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:31.893545 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-145148d2-41ff-4a25-bc3e-d741e6db16f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:32.002596 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d077a8d0-1194-4578-978e-205544ca243c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:32.003394 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d077a8d0-1194-4578-978e-205544ca243c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:32.010048 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d077a8d0-1194-4578-978e-205544ca243c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:32.010671 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d077a8d0-1194-4578-978e-205544ca243c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:32.011257 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d077a8d0-1194-4578-978e-205544ca243c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:32.012093 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d077a8d0-1194-4578-978e-205544ca243c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:32.012773 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d077a8d0-1194-4578-978e-205544ca243c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:32.013282 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d077a8d0-1194-4578-978e-205544ca243c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:32.033211 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-145148d2-41ff-4a25-bc3e-d741e6db16f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:32.042258 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-145148d2-41ff-4a25-bc3e-d741e6db16f9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1318 microversion: 2.1 time: 0.162865 Sep 11 00:59:32.043152 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 236/480] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:31 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:32.150984 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d077a8d0-1194-4578-978e-205544ca243c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:32.159023 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d077a8d0-1194-4578-978e-205544ca243c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1557 microversion: 2.1 time: 0.160562 Sep 11 00:59:32.159614 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 245/481] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:31 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:59:32.182126 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-22ab8776-b9dc-46ee-934d-6814b2f0b1bb tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:32.182617 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-22ab8776-b9dc-46ee-934d-6814b2f0b1bb tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:32.188721 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-22ab8776-b9dc-46ee-934d-6814b2f0b1bb tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:32.189211 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-22ab8776-b9dc-46ee-934d-6814b2f0b1bb tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:32.189680 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-22ab8776-b9dc-46ee-934d-6814b2f0b1bb tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:32.191138 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-22ab8776-b9dc-46ee-934d-6814b2f0b1bb tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:32.191618 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-22ab8776-b9dc-46ee-934d-6814b2f0b1bb tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:32.192046 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-22ab8776-b9dc-46ee-934d-6814b2f0b1bb tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:32.269409 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-22ab8776-b9dc-46ee-934d-6814b2f0b1bb tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091125 Sep 11 00:59:32.270082 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 237/482] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Sep 11 00:59:32 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:32.285353 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-0f09a79e-0dbb-4b6c-8203-14ecaf1c28c6 req-e8b3566f-89d1-4ba4-ab53-b52a6d4cddd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f34396ab-470f-47af-8d80-0bcd71d6bd36", "tag": "c85f56d0-288e-4e3d-abc7-3ca802d5eb06"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:32.297318 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-0f09a79e-0dbb-4b6c-8203-14ecaf1c28c6 req-e8b3566f-89d1-4ba4-ab53-b52a6d4cddd0 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:32.298255 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-0f09a79e-0dbb-4b6c-8203-14ecaf1c28c6 req-e8b3566f-89d1-4ba4-ab53-b52a6d4cddd0 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:32.298845 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-0f09a79e-0dbb-4b6c-8203-14ecaf1c28c6 req-e8b3566f-89d1-4ba4-ab53-b52a6d4cddd0 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:32.311568 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-0f09a79e-0dbb-4b6c-8203-14ecaf1c28c6 req-e8b3566f-89d1-4ba4-ab53-b52a6d4cddd0 service nova] Creating event network-changed:c85f56d0-288e-4e3d-abc7-3ca802d5eb06 for instance f34396ab-470f-47af-8d80-0bcd71d6bd36 on hv-cinder-maste Sep 11 00:59:32.316814 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-0f09a79e-0dbb-4b6c-8203-14ecaf1c28c6 req-e8b3566f-89d1-4ba4-ab53-b52a6d4cddd0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037063 Sep 11 00:59:32.317416 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 246/483] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:32.695004 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4f65e4d0-d596-4abc-a69a-ef334a7f33d2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:32.695585 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4f65e4d0-d596-4abc-a69a-ef334a7f33d2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:32.701565 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f65e4d0-d596-4abc-a69a-ef334a7f33d2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:32.702042 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f65e4d0-d596-4abc-a69a-ef334a7f33d2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:32.702910 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f65e4d0-d596-4abc-a69a-ef334a7f33d2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:32.703140 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f65e4d0-d596-4abc-a69a-ef334a7f33d2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:32.703614 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f65e4d0-d596-4abc-a69a-ef334a7f33d2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:32.704371 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f65e4d0-d596-4abc-a69a-ef334a7f33d2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:32.933975 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4f65e4d0-d596-4abc-a69a-ef334a7f33d2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:32.944273 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4f65e4d0-d596-4abc-a69a-ef334a7f33d2 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.253356 Sep 11 00:59:32.944821 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 238/484] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:32 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:33.066407 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-08769d52-757e-44a6-ae61-bf166c1b165d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:33.066966 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-08769d52-757e-44a6-ae61-bf166c1b165d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:33.073968 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08769d52-757e-44a6-ae61-bf166c1b165d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:33.074459 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08769d52-757e-44a6-ae61-bf166c1b165d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:33.074887 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08769d52-757e-44a6-ae61-bf166c1b165d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:33.075639 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08769d52-757e-44a6-ae61-bf166c1b165d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:33.076082 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08769d52-757e-44a6-ae61-bf166c1b165d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:33.076501 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-08769d52-757e-44a6-ae61-bf166c1b165d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:33.402782 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-08769d52-757e-44a6-ae61-bf166c1b165d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:33.410868 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-08769d52-757e-44a6-ae61-bf166c1b165d tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1318 microversion: 2.1 time: 0.349523 Sep 11 00:59:33.411459 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 247/485] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:33 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:33.557032 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-8d038d1a-5e1b-4f2f-b34b-2a5b3ce0f913 req-6d87468b-c61a-4b57-96e4-9635d3da7514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68ba728f-6c2a-4a9c-8f55-d87c0046b7b1", "tag": "70298aae-6b4c-46bf-9ebc-8c03965f50cf"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:33.566533 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-8d038d1a-5e1b-4f2f-b34b-2a5b3ce0f913 req-6d87468b-c61a-4b57-96e4-9635d3da7514 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:33.567014 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-8d038d1a-5e1b-4f2f-b34b-2a5b3ce0f913 req-6d87468b-c61a-4b57-96e4-9635d3da7514 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:33.567465 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-8d038d1a-5e1b-4f2f-b34b-2a5b3ce0f913 req-6d87468b-c61a-4b57-96e4-9635d3da7514 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:33.578758 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-8d038d1a-5e1b-4f2f-b34b-2a5b3ce0f913 req-6d87468b-c61a-4b57-96e4-9635d3da7514 service nova] Creating event network-changed:70298aae-6b4c-46bf-9ebc-8c03965f50cf for instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 on hv-cinder-maste Sep 11 00:59:33.584026 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-8d038d1a-5e1b-4f2f-b34b-2a5b3ce0f913 req-6d87468b-c61a-4b57-96e4-9635d3da7514 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030694 Sep 11 00:59:33.584944 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 239/486] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:33.967903 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3e222efa-8aff-4215-85ce-7adb80d2bf82 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:33.968845 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3e222efa-8aff-4215-85ce-7adb80d2bf82 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:33.976392 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e222efa-8aff-4215-85ce-7adb80d2bf82 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:33.976878 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e222efa-8aff-4215-85ce-7adb80d2bf82 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:33.977299 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e222efa-8aff-4215-85ce-7adb80d2bf82 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:33.977992 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e222efa-8aff-4215-85ce-7adb80d2bf82 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:33.978435 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e222efa-8aff-4215-85ce-7adb80d2bf82 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:33.978846 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e222efa-8aff-4215-85ce-7adb80d2bf82 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:34.196218 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3e222efa-8aff-4215-85ce-7adb80d2bf82 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:34.212891 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3e222efa-8aff-4215-85ce-7adb80d2bf82 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.248727 Sep 11 00:59:34.214698 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 248/487] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:33 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:34.442289 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bc123ade-50eb-47ff-81b3-0e21778917bf tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:34.443002 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bc123ade-50eb-47ff-81b3-0e21778917bf tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:34.450179 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc123ade-50eb-47ff-81b3-0e21778917bf tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:34.450650 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc123ade-50eb-47ff-81b3-0e21778917bf tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:34.451118 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc123ade-50eb-47ff-81b3-0e21778917bf tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:34.451862 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc123ade-50eb-47ff-81b3-0e21778917bf tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:34.452319 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc123ade-50eb-47ff-81b3-0e21778917bf tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:34.452740 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc123ade-50eb-47ff-81b3-0e21778917bf tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:34.596493 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-bc123ade-50eb-47ff-81b3-0e21778917bf tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:34.604249 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bc123ade-50eb-47ff-81b3-0e21778917bf tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1318 microversion: 2.1 time: 0.169770 Sep 11 00:59:34.604878 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 240/488] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:34 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:35.238116 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-4df0b197-6174-429a-a947-29b91bf2c522 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:35.238686 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-4df0b197-6174-429a-a947-29b91bf2c522 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:35.245556 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4df0b197-6174-429a-a947-29b91bf2c522 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:35.246034 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4df0b197-6174-429a-a947-29b91bf2c522 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:35.246468 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4df0b197-6174-429a-a947-29b91bf2c522 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:35.247155 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4df0b197-6174-429a-a947-29b91bf2c522 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:35.247630 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4df0b197-6174-429a-a947-29b91bf2c522 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:35.248044 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4df0b197-6174-429a-a947-29b91bf2c522 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:35.378200 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-4df0b197-6174-429a-a947-29b91bf2c522 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:35.386974 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-4df0b197-6174-429a-a947-29b91bf2c522 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.152998 Sep 11 00:59:35.387595 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 249/489] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:35 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:35.626127 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-56f12adf-00fd-4505-b7b1-25a95d0e7387 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:35.626737 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-56f12adf-00fd-4505-b7b1-25a95d0e7387 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:35.633653 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-56f12adf-00fd-4505-b7b1-25a95d0e7387 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:35.634137 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-56f12adf-00fd-4505-b7b1-25a95d0e7387 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:35.634566 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-56f12adf-00fd-4505-b7b1-25a95d0e7387 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:35.635287 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-56f12adf-00fd-4505-b7b1-25a95d0e7387 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:35.635738 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-56f12adf-00fd-4505-b7b1-25a95d0e7387 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:35.636158 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-56f12adf-00fd-4505-b7b1-25a95d0e7387 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:35.771459 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-56f12adf-00fd-4505-b7b1-25a95d0e7387 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:35.779579 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-56f12adf-00fd-4505-b7b1-25a95d0e7387 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1318 microversion: 2.1 time: 0.157307 Sep 11 00:59:35.780129 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 241/490] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:35 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:36.414992 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0c17cc81-2e34-4be7-9621-31ad6da1e665 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:36.416279 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-0c17cc81-2e34-4be7-9621-31ad6da1e665 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:36.426246 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0c17cc81-2e34-4be7-9621-31ad6da1e665 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:36.426721 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0c17cc81-2e34-4be7-9621-31ad6da1e665 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:36.427152 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0c17cc81-2e34-4be7-9621-31ad6da1e665 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:36.427863 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0c17cc81-2e34-4be7-9621-31ad6da1e665 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:36.428303 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0c17cc81-2e34-4be7-9621-31ad6da1e665 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:36.428721 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0c17cc81-2e34-4be7-9621-31ad6da1e665 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:36.443773 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:36.562239 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0c17cc81-2e34-4be7-9621-31ad6da1e665 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:36.570945 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0c17cc81-2e34-4be7-9621-31ad6da1e665 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.162558 Sep 11 00:59:36.571633 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 250/491] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:36 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:36.804768 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b9dc8085-86b2-4a4a-b746-c08fbd9a9593 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:36.805566 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b9dc8085-86b2-4a4a-b746-c08fbd9a9593 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:36.814223 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b9dc8085-86b2-4a4a-b746-c08fbd9a9593 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:36.814970 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b9dc8085-86b2-4a4a-b746-c08fbd9a9593 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:36.815437 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b9dc8085-86b2-4a4a-b746-c08fbd9a9593 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:36.816148 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b9dc8085-86b2-4a4a-b746-c08fbd9a9593 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:36.816585 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b9dc8085-86b2-4a4a-b746-c08fbd9a9593 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:36.817014 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b9dc8085-86b2-4a4a-b746-c08fbd9a9593 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:36.960912 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b9dc8085-86b2-4a4a-b746-c08fbd9a9593 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:36.972938 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b9dc8085-86b2-4a4a-b746-c08fbd9a9593 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1318 microversion: 2.1 time: 0.173153 Sep 11 00:59:36.973811 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 242/492] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:36 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:37.372247 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-d7983076-6f68-432b-913a-532ad36c1d75 req-4d4a8e7a-bfef-4ff3-8250-9deac638a51a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34396ab-470f-47af-8d80-0bcd71d6bd36", "name": "network-vif-plugged", "status": "completed", "tag": "c85f56d0-288e-4e3d-abc7-3ca802d5eb06"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:37.382347 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-d7983076-6f68-432b-913a-532ad36c1d75 req-4d4a8e7a-bfef-4ff3-8250-9deac638a51a service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:37.382820 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-d7983076-6f68-432b-913a-532ad36c1d75 req-4d4a8e7a-bfef-4ff3-8250-9deac638a51a service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:37.383283 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-d7983076-6f68-432b-913a-532ad36c1d75 req-4d4a8e7a-bfef-4ff3-8250-9deac638a51a service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:37.396302 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-d7983076-6f68-432b-913a-532ad36c1d75 req-4d4a8e7a-bfef-4ff3-8250-9deac638a51a service nova] Creating event network-vif-plugged:c85f56d0-288e-4e3d-abc7-3ca802d5eb06 for instance f34396ab-470f-47af-8d80-0bcd71d6bd36 on hv-cinder-maste Sep 11 00:59:37.401660 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-d7983076-6f68-432b-913a-532ad36c1d75 req-4d4a8e7a-bfef-4ff3-8250-9deac638a51a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033156 Sep 11 00:59:37.402244 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 251/493] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:37.551651 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b0cca299-6c65-4d78-81a3-e6f3006390d1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:37.552453 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b0cca299-6c65-4d78-81a3-e6f3006390d1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:37.558754 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b0cca299-6c65-4d78-81a3-e6f3006390d1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:37.559862 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b0cca299-6c65-4d78-81a3-e6f3006390d1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:37.560296 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b0cca299-6c65-4d78-81a3-e6f3006390d1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:37.561241 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b0cca299-6c65-4d78-81a3-e6f3006390d1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:37.561843 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b0cca299-6c65-4d78-81a3-e6f3006390d1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:37.562288 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b0cca299-6c65-4d78-81a3-e6f3006390d1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:37.594023 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b0cca299-6c65-4d78-81a3-e6f3006390d1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments/7fe6fae6-1726-4f33-9351-8466fa5ec1a8" status: 200 len: 194 microversion: 2.20 time: 0.047457 Sep 11 00:59:37.594663 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 243/494] 10.222.0.23 () {60 vars in 1454 bytes} [Sun Sep 11 00:59:37 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments/7fe6fae6-1726-4f33-9351-8466fa5ec1a8 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:59:37.596229 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c47ac746-5198-48ed-83fa-fcc14afdc75d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:37.596920 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c47ac746-5198-48ed-83fa-fcc14afdc75d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:37.603222 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c47ac746-5198-48ed-83fa-fcc14afdc75d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:37.603699 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c47ac746-5198-48ed-83fa-fcc14afdc75d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:37.604123 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c47ac746-5198-48ed-83fa-fcc14afdc75d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:37.604806 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c47ac746-5198-48ed-83fa-fcc14afdc75d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:37.605242 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c47ac746-5198-48ed-83fa-fcc14afdc75d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:37.605649 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c47ac746-5198-48ed-83fa-fcc14afdc75d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:37.667207 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5a6fcb86-9255-4aab-bf64-81ee267da891 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:37.667856 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5a6fcb86-9255-4aab-bf64-81ee267da891 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:37.674728 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a6fcb86-9255-4aab-bf64-81ee267da891 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:37.675331 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a6fcb86-9255-4aab-bf64-81ee267da891 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:37.675836 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a6fcb86-9255-4aab-bf64-81ee267da891 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:37.676603 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a6fcb86-9255-4aab-bf64-81ee267da891 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:37.677128 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a6fcb86-9255-4aab-bf64-81ee267da891 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:37.677625 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a6fcb86-9255-4aab-bf64-81ee267da891 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:37.759785 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-5a6fcb86-9255-4aab-bf64-81ee267da891 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lazy-loading 'services' on Instance uuid 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:59:37.768851 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c47ac746-5198-48ed-83fa-fcc14afdc75d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:37.777326 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c47ac746-5198-48ed-83fa-fcc14afdc75d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.185901 Sep 11 00:59:37.778153 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 252/495] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:37 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:59:37.835737 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5a6fcb86-9255-4aab-bf64-81ee267da891 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "DELETE /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments/7fe6fae6-1726-4f33-9351-8466fa5ec1a8" status: 202 len: 0 microversion: 2.20 time: 0.172877 Sep 11 00:59:37.836322 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 244/496] 10.222.0.23 () {60 vars in 1457 bytes} [Sun Sep 11 00:59:37 2022] DELETE /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments/7fe6fae6-1726-4f33-9351-8466fa5ec1a8 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 11 00:59:37.844878 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-35276eaa-a4fc-4bf1-b09d-eade69db9a99 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:37.847077 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-35276eaa-a4fc-4bf1-b09d-eade69db9a99 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:37.853433 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-35276eaa-a4fc-4bf1-b09d-eade69db9a99 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:37.853922 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-35276eaa-a4fc-4bf1-b09d-eade69db9a99 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:37.854356 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-35276eaa-a4fc-4bf1-b09d-eade69db9a99 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:37.855044 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-35276eaa-a4fc-4bf1-b09d-eade69db9a99 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:37.855534 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-35276eaa-a4fc-4bf1-b09d-eade69db9a99 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:37.855956 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-35276eaa-a4fc-4bf1-b09d-eade69db9a99 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:37.886072 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-35276eaa-a4fc-4bf1-b09d-eade69db9a99 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045161 Sep 11 00:59:37.886631 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 253/497] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Sep 11 00:59:37 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:59:38.005846 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-94c4156d-26e3-40a1-96c9-5ec3c8c6e9e4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:38.006878 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-94c4156d-26e3-40a1-96c9-5ec3c8c6e9e4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:38.017316 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-94c4156d-26e3-40a1-96c9-5ec3c8c6e9e4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:38.018243 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-94c4156d-26e3-40a1-96c9-5ec3c8c6e9e4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:38.018672 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-94c4156d-26e3-40a1-96c9-5ec3c8c6e9e4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:38.019400 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-94c4156d-26e3-40a1-96c9-5ec3c8c6e9e4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:38.019848 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-94c4156d-26e3-40a1-96c9-5ec3c8c6e9e4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:38.020270 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-94c4156d-26e3-40a1-96c9-5ec3c8c6e9e4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:38.157243 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-94c4156d-26e3-40a1-96c9-5ec3c8c6e9e4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:38.165490 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-94c4156d-26e3-40a1-96c9-5ec3c8c6e9e4 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1318 microversion: 2.1 time: 0.166886 Sep 11 00:59:38.166423 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 245/498] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:37 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:38.805710 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-151957e4-5ad1-4d58-a9d8-7b710cf53830 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:38.806709 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-151957e4-5ad1-4d58-a9d8-7b710cf53830 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:38.817195 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-151957e4-5ad1-4d58-a9d8-7b710cf53830 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:38.817736 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-151957e4-5ad1-4d58-a9d8-7b710cf53830 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:38.818154 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-151957e4-5ad1-4d58-a9d8-7b710cf53830 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:38.818866 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-151957e4-5ad1-4d58-a9d8-7b710cf53830 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:38.819345 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-151957e4-5ad1-4d58-a9d8-7b710cf53830 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:38.819759 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-151957e4-5ad1-4d58-a9d8-7b710cf53830 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:38.898779 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-06bb4410-9d19-43c8-8d63-cfe6a1f0aa5e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:38.901071 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-06bb4410-9d19-43c8-8d63-cfe6a1f0aa5e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:38.903449 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:38.904500 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=8 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:38.911637 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-06bb4410-9d19-43c8-8d63-cfe6a1f0aa5e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:38.912192 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-06bb4410-9d19-43c8-8d63-cfe6a1f0aa5e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:38.912802 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-06bb4410-9d19-43c8-8d63-cfe6a1f0aa5e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:38.913765 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-06bb4410-9d19-43c8-8d63-cfe6a1f0aa5e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:38.914345 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-06bb4410-9d19-43c8-8d63-cfe6a1f0aa5e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:38.914839 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-06bb4410-9d19-43c8-8d63-cfe6a1f0aa5e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:38.947197 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-06bb4410-9d19-43c8-8d63-cfe6a1f0aa5e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052804 Sep 11 00:59:38.947958 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 246/499] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Sep 11 00:59:38 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:59:38.950859 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-151957e4-5ad1-4d58-a9d8-7b710cf53830 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:38.959264 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-151957e4-5ad1-4d58-a9d8-7b710cf53830 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.160103 Sep 11 00:59:38.959824 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 254/500] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:38 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:39.190837 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3b9c4a6d-feed-4b4c-a220-03bc2fabf877 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:39.191568 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3b9c4a6d-feed-4b4c-a220-03bc2fabf877 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:39.198174 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a6d-feed-4b4c-a220-03bc2fabf877 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:39.198658 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a6d-feed-4b4c-a220-03bc2fabf877 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:39.199087 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a6d-feed-4b4c-a220-03bc2fabf877 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:39.199878 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a6d-feed-4b4c-a220-03bc2fabf877 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:39.200751 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a6d-feed-4b4c-a220-03bc2fabf877 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:39.200873 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3b9c4a6d-feed-4b4c-a220-03bc2fabf877 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:39.338133 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3b9c4a6d-feed-4b4c-a220-03bc2fabf877 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:39.349836 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3b9c4a6d-feed-4b4c-a220-03bc2fabf877 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1318 microversion: 2.1 time: 0.162864 Sep 11 00:59:39.350584 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 247/501] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:39 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:39.961093 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-257c1ebc-2c50-4c03-a6bb-307bfc39d5a3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:39.963313 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-257c1ebc-2c50-4c03-a6bb-307bfc39d5a3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:39.970161 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-257c1ebc-2c50-4c03-a6bb-307bfc39d5a3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:39.970643 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-257c1ebc-2c50-4c03-a6bb-307bfc39d5a3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:39.971064 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-257c1ebc-2c50-4c03-a6bb-307bfc39d5a3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:39.971836 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-257c1ebc-2c50-4c03-a6bb-307bfc39d5a3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:39.972442 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-257c1ebc-2c50-4c03-a6bb-307bfc39d5a3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:39.972866 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-257c1ebc-2c50-4c03-a6bb-307bfc39d5a3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:39.982081 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aea66b39-69d7-4ac4-8520-576ea86eeb13 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:39.982657 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-aea66b39-69d7-4ac4-8520-576ea86eeb13 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:39.989599 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aea66b39-69d7-4ac4-8520-576ea86eeb13 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:39.990086 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aea66b39-69d7-4ac4-8520-576ea86eeb13 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:39.990511 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aea66b39-69d7-4ac4-8520-576ea86eeb13 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:39.991221 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aea66b39-69d7-4ac4-8520-576ea86eeb13 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:39.991680 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aea66b39-69d7-4ac4-8520-576ea86eeb13 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:39.992095 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aea66b39-69d7-4ac4-8520-576ea86eeb13 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:40.004060 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-257c1ebc-2c50-4c03-a6bb-307bfc39d5a3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047179 Sep 11 00:59:40.004614 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 255/502] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Sep 11 00:59:39 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:59:40.128525 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-aea66b39-69d7-4ac4-8520-576ea86eeb13 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:40.137301 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-aea66b39-69d7-4ac4-8520-576ea86eeb13 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.159116 Sep 11 00:59:40.137865 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 248/503] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:39 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:40.376776 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a6f6f670-4525-48ec-930e-05a95b2c2b8e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:40.377704 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a6f6f670-4525-48ec-930e-05a95b2c2b8e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:40.384568 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a6f6f670-4525-48ec-930e-05a95b2c2b8e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:40.385073 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a6f6f670-4525-48ec-930e-05a95b2c2b8e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:40.385504 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a6f6f670-4525-48ec-930e-05a95b2c2b8e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:40.386189 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a6f6f670-4525-48ec-930e-05a95b2c2b8e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:40.386635 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a6f6f670-4525-48ec-930e-05a95b2c2b8e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:40.387053 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a6f6f670-4525-48ec-930e-05a95b2c2b8e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:40.520867 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a6f6f670-4525-48ec-930e-05a95b2c2b8e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:40.532623 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a6f6f670-4525-48ec-930e-05a95b2c2b8e tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1508 microversion: 2.1 time: 0.161921 Sep 11 00:59:40.533345 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 256/504] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:40 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:40.555512 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-70ee886c-83ce-4ed1-beb1-f30ee8d005e1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "892e2654-c985-4d90-963a-4e418d86d162", "device": "/dev/sdb"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:40.557893 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-70ee886c-83ce-4ed1-beb1-f30ee8d005e1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:40.564352 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-70ee886c-83ce-4ed1-beb1-f30ee8d005e1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:40.564828 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-70ee886c-83ce-4ed1-beb1-f30ee8d005e1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:40.565251 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-70ee886c-83ce-4ed1-beb1-f30ee8d005e1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:40.566023 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-70ee886c-83ce-4ed1-beb1-f30ee8d005e1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:40.566466 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-70ee886c-83ce-4ed1-beb1-f30ee8d005e1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:40.566884 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-70ee886c-83ce-4ed1-beb1-f30ee8d005e1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:41.020820 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3903f7fc-d449-44a5-8c0c-0e181a11d860 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:41.023374 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3903f7fc-d449-44a5-8c0c-0e181a11d860 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:41.031233 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3903f7fc-d449-44a5-8c0c-0e181a11d860 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:41.031811 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3903f7fc-d449-44a5-8c0c-0e181a11d860 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:41.032331 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3903f7fc-d449-44a5-8c0c-0e181a11d860 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:41.033142 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3903f7fc-d449-44a5-8c0c-0e181a11d860 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:41.033670 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3903f7fc-d449-44a5-8c0c-0e181a11d860 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:41.034167 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3903f7fc-d449-44a5-8c0c-0e181a11d860 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:41.064850 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3903f7fc-d449-44a5-8c0c-0e181a11d860 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050412 Sep 11 00:59:41.065408 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 257/505] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Sep 11 00:59:41 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 00:59:41.161161 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ff520e63-4868-4c6c-906f-e2fab1f093f9 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:41.161807 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ff520e63-4868-4c6c-906f-e2fab1f093f9 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:41.163775 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:41.169705 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ff520e63-4868-4c6c-906f-e2fab1f093f9 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:41.170188 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ff520e63-4868-4c6c-906f-e2fab1f093f9 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:41.170677 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ff520e63-4868-4c6c-906f-e2fab1f093f9 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:41.171405 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ff520e63-4868-4c6c-906f-e2fab1f093f9 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:41.171858 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ff520e63-4868-4c6c-906f-e2fab1f093f9 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:41.172301 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ff520e63-4868-4c6c-906f-e2fab1f093f9 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:41.314205 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ff520e63-4868-4c6c-906f-e2fab1f093f9 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:41.322688 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ff520e63-4868-4c6c-906f-e2fab1f093f9 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.165582 Sep 11 00:59:41.323294 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 258/506] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:41 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:41.791839 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-70ee886c-83ce-4ed1-beb1-f30ee8d005e1 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "POST /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.240123 Sep 11 00:59:41.792443 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 249/507] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Sep 11 00:59:40 2022] POST /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36/os-volume_attachments => generated 194 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:42.079213 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-9cac9dfb-328c-48fa-93f5-aecddec30141 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:42.081846 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-9cac9dfb-328c-48fa-93f5-aecddec30141 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:42.091366 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9cac9dfb-328c-48fa-93f5-aecddec30141 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:42.091967 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9cac9dfb-328c-48fa-93f5-aecddec30141 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:42.092503 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9cac9dfb-328c-48fa-93f5-aecddec30141 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:42.093356 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9cac9dfb-328c-48fa-93f5-aecddec30141 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:42.093938 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9cac9dfb-328c-48fa-93f5-aecddec30141 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:42.094429 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9cac9dfb-328c-48fa-93f5-aecddec30141 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:42.125990 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-9cac9dfb-328c-48fa-93f5-aecddec30141 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051884 Sep 11 00:59:42.126564 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 259/508] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Sep 11 00:59:42 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:42.193694 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4ee49bbc-e7ee-4ee8-a233-3e79468bac0a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:42.194310 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4ee49bbc-e7ee-4ee8-a233-3e79468bac0a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:42.200759 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ee49bbc-e7ee-4ee8-a233-3e79468bac0a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:42.201243 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ee49bbc-e7ee-4ee8-a233-3e79468bac0a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:42.202064 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ee49bbc-e7ee-4ee8-a233-3e79468bac0a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:42.202692 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ee49bbc-e7ee-4ee8-a233-3e79468bac0a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:42.203146 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ee49bbc-e7ee-4ee8-a233-3e79468bac0a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:42.203671 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ee49bbc-e7ee-4ee8-a233-3e79468bac0a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:42.218794 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:42.231265 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4ee49bbc-e7ee-4ee8-a233-3e79468bac0a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 00:59:42.310339 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4ee49bbc-e7ee-4ee8-a233-3e79468bac0a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "DELETE /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 204 len: 0 microversion: 2.20 time: 0.121250 Sep 11 00:59:42.311365 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 250/509] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Sep 11 00:59:42 2022] DELETE /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 11 00:59:42.323013 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f4d0c813-3ec0-422f-b801-a2e5bd1ca609 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:42.323643 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f4d0c813-3ec0-422f-b801-a2e5bd1ca609 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:42.329915 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f4d0c813-3ec0-422f-b801-a2e5bd1ca609 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:42.330325 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f4d0c813-3ec0-422f-b801-a2e5bd1ca609 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:42.330751 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f4d0c813-3ec0-422f-b801-a2e5bd1ca609 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:42.331535 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f4d0c813-3ec0-422f-b801-a2e5bd1ca609 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:42.331980 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f4d0c813-3ec0-422f-b801-a2e5bd1ca609 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:42.332400 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f4d0c813-3ec0-422f-b801-a2e5bd1ca609 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:42.346821 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c6ec5dc5-5135-4e44-87ee-8274892be736 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:42.347545 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c6ec5dc5-5135-4e44-87ee-8274892be736 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:42.354568 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6ec5dc5-5135-4e44-87ee-8274892be736 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:42.355074 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6ec5dc5-5135-4e44-87ee-8274892be736 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:42.355539 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6ec5dc5-5135-4e44-87ee-8274892be736 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:42.356237 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6ec5dc5-5135-4e44-87ee-8274892be736 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:42.356693 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6ec5dc5-5135-4e44-87ee-8274892be736 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:42.357117 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6ec5dc5-5135-4e44-87ee-8274892be736 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:42.529919 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f4d0c813-3ec0-422f-b801-a2e5bd1ca609 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:42.534661 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c6ec5dc5-5135-4e44-87ee-8274892be736 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:42.539712 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f4d0c813-3ec0-422f-b801-a2e5bd1ca609 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:42.541525 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f4d0c813-3ec0-422f-b801-a2e5bd1ca609 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:42.542670 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f4d0c813-3ec0-422f-b801-a2e5bd1ca609 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.224780 Sep 11 00:59:42.543235 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 260/510] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:59:42 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:59:42.543607 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c6ec5dc5-5135-4e44-87ee-8274892be736 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.201070 Sep 11 00:59:42.544196 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 251/511] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:42 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 00:59:43.570488 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-cdc89b24-b75e-4d40-acb6-e592e2522468 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:43.571164 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-cdc89b24-b75e-4d40-acb6-e592e2522468 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:43.572037 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-dc2f8ec3-bbf4-49ff-aec7-0c8328e5f156 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:43.572798 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-dc2f8ec3-bbf4-49ff-aec7-0c8328e5f156 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:43.579847 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cdc89b24-b75e-4d40-acb6-e592e2522468 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:43.580451 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cdc89b24-b75e-4d40-acb6-e592e2522468 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:43.581104 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cdc89b24-b75e-4d40-acb6-e592e2522468 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:43.581290 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc2f8ec3-bbf4-49ff-aec7-0c8328e5f156 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:43.581833 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc2f8ec3-bbf4-49ff-aec7-0c8328e5f156 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:43.582456 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc2f8ec3-bbf4-49ff-aec7-0c8328e5f156 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:43.583349 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc2f8ec3-bbf4-49ff-aec7-0c8328e5f156 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:43.583907 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc2f8ec3-bbf4-49ff-aec7-0c8328e5f156 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:43.584265 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cdc89b24-b75e-4d40-acb6-e592e2522468 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:43.584435 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc2f8ec3-bbf4-49ff-aec7-0c8328e5f156 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:43.584933 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cdc89b24-b75e-4d40-acb6-e592e2522468 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:43.585467 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cdc89b24-b75e-4d40-acb6-e592e2522468 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:43.811576 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-dc2f8ec3-bbf4-49ff-aec7-0c8328e5f156 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:43.818314 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-cdc89b24-b75e-4d40-acb6-e592e2522468 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:43.825475 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-dc2f8ec3-bbf4-49ff-aec7-0c8328e5f156 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:43.827971 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-dc2f8ec3-bbf4-49ff-aec7-0c8328e5f156 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:43.829835 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-dc2f8ec3-bbf4-49ff-aec7-0c8328e5f156 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.262338 Sep 11 00:59:43.830750 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 252/512] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:59:43 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:59:43.834246 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-cdc89b24-b75e-4d40-acb6-e592e2522468 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1736 microversion: 2.1 time: 0.268184 Sep 11 00:59:43.834246 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 261/513] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:43 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1736 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:44.860318 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fd7153cf-0ddf-427e-879c-27ba34b812f1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:44.861233 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c91a0fc1-7631-419d-8dde-bf45299e29f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:44.861833 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-fd7153cf-0ddf-427e-879c-27ba34b812f1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:44.862031 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c91a0fc1-7631-419d-8dde-bf45299e29f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:44.872427 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fd7153cf-0ddf-427e-879c-27ba34b812f1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:44.872763 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c91a0fc1-7631-419d-8dde-bf45299e29f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:44.873226 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fd7153cf-0ddf-427e-879c-27ba34b812f1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:44.873481 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c91a0fc1-7631-419d-8dde-bf45299e29f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:44.873932 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fd7153cf-0ddf-427e-879c-27ba34b812f1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:44.874188 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c91a0fc1-7631-419d-8dde-bf45299e29f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:44.875053 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fd7153cf-0ddf-427e-879c-27ba34b812f1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:44.875322 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c91a0fc1-7631-419d-8dde-bf45299e29f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:44.875830 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fd7153cf-0ddf-427e-879c-27ba34b812f1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:44.876070 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c91a0fc1-7631-419d-8dde-bf45299e29f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:44.876515 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fd7153cf-0ddf-427e-879c-27ba34b812f1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:44.876749 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c91a0fc1-7631-419d-8dde-bf45299e29f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:45.071463 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-fd7153cf-0ddf-427e-879c-27ba34b812f1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:45.076198 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c91a0fc1-7631-419d-8dde-bf45299e29f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:45.079912 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-fd7153cf-0ddf-427e-879c-27ba34b812f1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:45.081374 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-fd7153cf-0ddf-427e-879c-27ba34b812f1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:45.082581 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-fd7153cf-0ddf-427e-879c-27ba34b812f1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.228970 Sep 11 00:59:45.083139 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 253/514] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:59:44 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:59:45.085119 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c91a0fc1-7631-419d-8dde-bf45299e29f6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1716 microversion: 2.1 time: 0.231185 Sep 11 00:59:45.085668 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 262/515] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:44 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1716 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:45.214283 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0411518c-2974-4374-b5d7-aff8a744a48b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:45.214783 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0411518c-2974-4374-b5d7-aff8a744a48b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:45.220780 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0411518c-2974-4374-b5d7-aff8a744a48b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:45.221262 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0411518c-2974-4374-b5d7-aff8a744a48b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:45.221700 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0411518c-2974-4374-b5d7-aff8a744a48b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:45.222382 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0411518c-2974-4374-b5d7-aff8a744a48b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:45.222866 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0411518c-2974-4374-b5d7-aff8a744a48b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:45.223377 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0411518c-2974-4374-b5d7-aff8a744a48b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:45.315353 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-0411518c-2974-4374-b5d7-aff8a744a48b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] HTTP exception thrown: Cannot 'detach_volume' instance 56cf74eb-5098-47e8-b99c-efd0af892b66 while it is in vm_state rescued Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0411518c-2974-4374-b5d7-aff8a744a48b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Request method failure captured: Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: DELETE /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-volume_attachments/dcd0c282-d833-4270-960b-2089359ef810 HTTP/1.1 Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIZV3OGXS0Y0dMCJR3JsNV5yeizCzXf9d_TuViBBFaAqgn8TDP7z7jkssGhxEzL2Hkj8d0DyUdQPhy8rCBCc-PskzFupuPpZKa-RVGVZcBl67AuQkQbqQObAzrPZ5DBpyPNMKv8zeY6EtLRNUIutKSaCaDQe1MRr7gfF_WIm51FEcc Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: ac8c0850e1ac43e7913a88dbb7b7e9f8 Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 00:59:45.317038 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 00:59:45.318586 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8c0850e1ac43e7913a88dbb7b7e9f8", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:59:45.318586 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 00:59:45.318586 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: ac8c0850e1ac43e7913a88dbb7b7e9f8 Sep 11 00:59:45.318586 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 00:59:45.318586 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-ServerRescueNegativeTestJSON-2141619617-project Sep 11 00:59:45.318586 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 00:59:45.318586 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 00:59:45.318586 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 03a3c989ecef42e084fb44d47c55b27e Sep 11 00:59:45.318586 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2141619617-project Sep 11 00:59:45.318586 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 00:59:45.318586 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Cannot 'detach_volume' instance 56cf74eb-5098-47e8-b99c-efd0af892b66 while it is in vm_state rescued Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'server_id': '56cf74eb-5098-47e8-b99c-efd0af892b66', 'id': 'dcd0c282-d833-4270-960b-2089359ef810'} Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 56cf74eb-5098-47e8-b99c-efd0af892b66 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:59:45.319445 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 56cf74eb-5098-47e8-b99c-efd0af892b66 while it is in vm_state rescued Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 56cf74eb-5098-47e8-b99c-efd0af892b66 while it is in vm_state rescued Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:45.320779 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0411518c-2974-4374-b5d7-aff8a744a48b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Returning 409 to user: Cannot 'detach_volume' instance 56cf74eb-5098-47e8-b99c-efd0af892b66 while it is in vm_state rescued {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:59:45.321779 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0411518c-2974-4374-b5d7-aff8a744a48b tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "DELETE /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-volume_attachments/dcd0c282-d833-4270-960b-2089359ef810" status: 409 len: 152 microversion: 2.1 time: 0.108253 Sep 11 00:59:45.321779 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 254/516] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Sep 11 00:59:45 2022] DELETE /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-volume_attachments/dcd0c282-d833-4270-960b-2089359ef810 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 11 00:59:45.330947 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-4095bf53-977e-405e-a0d2-2342216b8f85 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:45.331721 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-4095bf53-977e-405e-a0d2-2342216b8f85 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:45.337939 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4095bf53-977e-405e-a0d2-2342216b8f85 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:45.338415 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4095bf53-977e-405e-a0d2-2342216b8f85 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:45.338842 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4095bf53-977e-405e-a0d2-2342216b8f85 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:45.339549 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4095bf53-977e-405e-a0d2-2342216b8f85 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:45.340174 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4095bf53-977e-405e-a0d2-2342216b8f85 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:45.340606 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4095bf53-977e-405e-a0d2-2342216b8f85 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:45.412166 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-4095bf53-977e-405e-a0d2-2342216b8f85 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "POST /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/action" status: 202 len: 0 microversion: 2.1 time: 0.087531 Sep 11 00:59:45.416359 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 263/517] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Sep 11 00:59:45 2022] POST /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 00:59:45.421502 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5886f55d-c89a-4f26-a186-f39fe3c797f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:45.422197 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5886f55d-c89a-4f26-a186-f39fe3c797f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:45.428260 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5886f55d-c89a-4f26-a186-f39fe3c797f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:45.428736 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5886f55d-c89a-4f26-a186-f39fe3c797f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:45.429158 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5886f55d-c89a-4f26-a186-f39fe3c797f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:45.429839 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5886f55d-c89a-4f26-a186-f39fe3c797f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:45.430278 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5886f55d-c89a-4f26-a186-f39fe3c797f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:45.430684 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5886f55d-c89a-4f26-a186-f39fe3c797f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:45.570092 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-5886f55d-c89a-4f26-a186-f39fe3c797f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:45.578973 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5886f55d-c89a-4f26-a186-f39fe3c797f0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1724 microversion: 2.1 time: 0.161292 Sep 11 00:59:45.579596 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 255/518] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:45 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:46.110289 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-49bc62a1-c7e3-4210-820b-47fdeee5b06d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:46.111694 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-49bc62a1-c7e3-4210-820b-47fdeee5b06d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:46.118497 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-49bc62a1-c7e3-4210-820b-47fdeee5b06d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:46.119062 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-49bc62a1-c7e3-4210-820b-47fdeee5b06d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:46.119594 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-49bc62a1-c7e3-4210-820b-47fdeee5b06d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:46.120395 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-49bc62a1-c7e3-4210-820b-47fdeee5b06d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:46.120910 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-49bc62a1-c7e3-4210-820b-47fdeee5b06d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:46.121399 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-49bc62a1-c7e3-4210-820b-47fdeee5b06d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:46.382437 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-49bc62a1-c7e3-4210-820b-47fdeee5b06d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:46.391464 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-49bc62a1-c7e3-4210-820b-47fdeee5b06d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:46.392943 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-49bc62a1-c7e3-4210-820b-47fdeee5b06d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:46.394158 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-49bc62a1-c7e3-4210-820b-47fdeee5b06d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1724 microversion: 2.20 time: 0.289572 Sep 11 00:59:46.394702 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 264/519] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:59:46 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:59:46.602715 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a7c715d8-bd54-4d96-bcb6-1b0a72674df4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:46.603334 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a7c715d8-bd54-4d96-bcb6-1b0a72674df4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:46.610173 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a7c715d8-bd54-4d96-bcb6-1b0a72674df4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:46.610687 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a7c715d8-bd54-4d96-bcb6-1b0a72674df4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:46.611118 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a7c715d8-bd54-4d96-bcb6-1b0a72674df4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:46.611842 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a7c715d8-bd54-4d96-bcb6-1b0a72674df4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:46.612279 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a7c715d8-bd54-4d96-bcb6-1b0a72674df4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:46.612896 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a7c715d8-bd54-4d96-bcb6-1b0a72674df4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:46.862787 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a7c715d8-bd54-4d96-bcb6-1b0a72674df4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:46.874331 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a7c715d8-bd54-4d96-bcb6-1b0a72674df4 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1724 microversion: 2.1 time: 0.275537 Sep 11 00:59:46.875825 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 256/520] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:46 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:47.054236 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-c70e5bac-ca48-44fb-ba62-efd50b53e093 req-9a8e4517-86d2-4456-b279-6df7377f9ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185afbdf-74f7-4a54-8ba8-58e7b6fd2e73", "name": "network-vif-deleted", "tag": "903eede7-b91a-4899-9cea-f0ba8d7eea74"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:47.071633 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-c70e5bac-ca48-44fb-ba62-efd50b53e093 req-9a8e4517-86d2-4456-b279-6df7377f9ff8 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:47.072407 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-c70e5bac-ca48-44fb-ba62-efd50b53e093 req-9a8e4517-86d2-4456-b279-6df7377f9ff8 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:47.074042 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-c70e5bac-ca48-44fb-ba62-efd50b53e093 req-9a8e4517-86d2-4456-b279-6df7377f9ff8 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:47.089218 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-c70e5bac-ca48-44fb-ba62-efd50b53e093 req-9a8e4517-86d2-4456-b279-6df7377f9ff8 service nova] Creating event network-vif-deleted:903eede7-b91a-4899-9cea-f0ba8d7eea74 for instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 on hv-cinder-maste Sep 11 00:59:47.110063 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-c70e5bac-ca48-44fb-ba62-efd50b53e093 req-9a8e4517-86d2-4456-b279-6df7377f9ff8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059766 Sep 11 00:59:47.111325 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 265/521] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:47.420514 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:47.420981 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:47.430357 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:47.430892 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:47.431300 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:47.434993 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:47.435403 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:47.439239 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:47.484808 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:47.485337 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:47.485842 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:47.486572 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lazy-loading 'fault' on Instance uuid 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:59:47.568607 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:47.577266 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:47.578741 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:47.579909 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3582950c-2c3f-48d4-aadd-57f0c56e0200 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1371 microversion: 2.20 time: 0.164354 Sep 11 00:59:47.580473 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 257/522] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:59:47 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:59:47.721558 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-500ae877-53d0-4eb6-b205-20007cf6eb60 req-2981770e-fab5-4584-acd0-75e9f281333b admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "892e2654-c985-4d90-963a-4e418d86d162", "create_info": {"type": "qcow2", "new_file": "volume-892e2654-c985-4d90-963a-4e418d86d162.854ce204-1e4d-4066-88cf-c82439fc648e.vhdx", "snapshot_id": "854ce204-1e4d-4066-88cf-c82439fc648e"}}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:47.725190 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-500ae877-53d0-4eb6-b205-20007cf6eb60 req-2981770e-fab5-4584-acd0-75e9f281333b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:47.725799 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-500ae877-53d0-4eb6-b205-20007cf6eb60 req-2981770e-fab5-4584-acd0-75e9f281333b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:47.726427 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-500ae877-53d0-4eb6-b205-20007cf6eb60 req-2981770e-fab5-4584-acd0-75e9f281333b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:47.735862 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-500ae877-53d0-4eb6-b205-20007cf6eb60 req-2981770e-fab5-4584-acd0-75e9f281333b admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:47.736546 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-500ae877-53d0-4eb6-b205-20007cf6eb60 req-2981770e-fab5-4584-acd0-75e9f281333b admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:47.737136 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-500ae877-53d0-4eb6-b205-20007cf6eb60 req-2981770e-fab5-4584-acd0-75e9f281333b admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:47.752085 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-500ae877-53d0-4eb6-b205-20007cf6eb60 req-2981770e-fab5-4584-acd0-75e9f281333b admin admin] 10.222.0.46 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.094467 Sep 11 00:59:47.752668 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 266/523] 10.222.0.46 () {64 vars in 1326 bytes} [Sun Sep 11 00:59:47 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:59:47.899465 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-81970d4a-3d30-44a9-82cd-60a726aad324 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:47.900036 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-81970d4a-3d30-44a9-82cd-60a726aad324 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:47.902605 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:47.908403 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-81970d4a-3d30-44a9-82cd-60a726aad324 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:47.908903 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-81970d4a-3d30-44a9-82cd-60a726aad324 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:47.909340 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-81970d4a-3d30-44a9-82cd-60a726aad324 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:47.910054 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-81970d4a-3d30-44a9-82cd-60a726aad324 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:47.910586 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-81970d4a-3d30-44a9-82cd-60a726aad324 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:47.911008 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-81970d4a-3d30-44a9-82cd-60a726aad324 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:48.048092 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-81970d4a-3d30-44a9-82cd-60a726aad324 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:48.056818 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-81970d4a-3d30-44a9-82cd-60a726aad324 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1724 microversion: 2.1 time: 0.161346 Sep 11 00:59:48.057478 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 258/524] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:47 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:48.611976 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:48.613113 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:48.623703 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:48.624493 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:48.625220 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:48.626352 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:48.627094 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:48.627836 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:48.659792 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:48.660340 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:48.660801 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:48.661246 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lazy-loading 'fault' on Instance uuid 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:59:48.706268 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:48.708598 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:48.715929 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:48.717383 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:48.718564 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-5ce23d46-924f-4de3-8aef-37e1a62b885f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1371 microversion: 2.20 time: 0.114699 Sep 11 00:59:48.719060 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 267/525] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:59:48 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:59:49.084253 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-34a8cdca-43cc-45be-bbc2-4828d1c14942 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:49.085154 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-34a8cdca-43cc-45be-bbc2-4828d1c14942 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:49.093702 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-34a8cdca-43cc-45be-bbc2-4828d1c14942 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:49.094298 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-34a8cdca-43cc-45be-bbc2-4828d1c14942 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:49.094880 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-34a8cdca-43cc-45be-bbc2-4828d1c14942 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:49.095730 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-34a8cdca-43cc-45be-bbc2-4828d1c14942 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:49.096285 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-34a8cdca-43cc-45be-bbc2-4828d1c14942 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:49.096815 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-34a8cdca-43cc-45be-bbc2-4828d1c14942 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:49.233474 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-34a8cdca-43cc-45be-bbc2-4828d1c14942 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:49.242314 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-34a8cdca-43cc-45be-bbc2-4828d1c14942 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1724 microversion: 2.1 time: 0.164066 Sep 11 00:59:49.242917 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 259/526] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:49 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:49.747335 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:49.748402 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:49.759846 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:49.760478 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:49.761141 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:49.762194 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:49.762883 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:49.763581 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:49.799878 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:49.800373 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:49.800796 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:49.801230 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lazy-loading 'fault' on Instance uuid 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:59:49.845393 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:49.859438 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:49.861840 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:49.863705 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-b53829d8-4650-41e9-aef3-669dc108bacd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1371 microversion: 2.20 time: 0.123239 Sep 11 00:59:49.864625 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 268/527] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:59:49 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:59:50.266452 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6420f171-9d4b-4cb8-87ef-c2300860a8ec tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:50.267068 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6420f171-9d4b-4cb8-87ef-c2300860a8ec tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:50.273954 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6420f171-9d4b-4cb8-87ef-c2300860a8ec tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:50.274434 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6420f171-9d4b-4cb8-87ef-c2300860a8ec tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:50.274860 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6420f171-9d4b-4cb8-87ef-c2300860a8ec tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:50.275583 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6420f171-9d4b-4cb8-87ef-c2300860a8ec tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:50.276030 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6420f171-9d4b-4cb8-87ef-c2300860a8ec tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:50.276446 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6420f171-9d4b-4cb8-87ef-c2300860a8ec tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:50.478301 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6420f171-9d4b-4cb8-87ef-c2300860a8ec tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:50.487052 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6420f171-9d4b-4cb8-87ef-c2300860a8ec tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1730 microversion: 2.1 time: 0.224718 Sep 11 00:59:50.487667 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 260/528] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 00:59:50 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 00:59:50.509920 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-20e011eb-92d0-4a64-9bb0-82ad60f52b4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:50.510411 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-20e011eb-92d0-4a64-9bb0-82ad60f52b4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:50.516633 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-20e011eb-92d0-4a64-9bb0-82ad60f52b4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:50.517088 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-20e011eb-92d0-4a64-9bb0-82ad60f52b4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:50.517560 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-20e011eb-92d0-4a64-9bb0-82ad60f52b4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:50.518227 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-20e011eb-92d0-4a64-9bb0-82ad60f52b4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:50.518677 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-20e011eb-92d0-4a64-9bb0-82ad60f52b4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:50.519101 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-20e011eb-92d0-4a64-9bb0-82ad60f52b4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:50.598930 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-20e011eb-92d0-4a64-9bb0-82ad60f52b4d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092865 Sep 11 00:59:50.599586 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 269/529] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Sep 11 00:59:50 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:50.889426 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:50.889942 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:50.896694 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:50.897193 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:50.897636 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:50.898357 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:50.898831 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:50.899284 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:50.931657 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:50.932147 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:50.932581 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:50.933035 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lazy-loading 'fault' on Instance uuid 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 00:59:50.984424 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:50.992780 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:50.994217 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:50.995413 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6f0552ca-9410-4c13-87ab-9c218787188a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 200 len: 1371 microversion: 2.20 time: 0.110080 Sep 11 00:59:50.995971 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 261/530] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:59:50 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:59:51.731884 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-d0153ddc-f521-4391-9b74-056a0a99c420 req-1d9811c9-c45e-44b1-98fc-7d1432c135e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56cf74eb-5098-47e8-b99c-efd0af892b66", "tag": "5ae85da6-bc81-47ad-9baf-b2583a2b801b"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:51.741536 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-d0153ddc-f521-4391-9b74-056a0a99c420 req-1d9811c9-c45e-44b1-98fc-7d1432c135e8 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:51.742008 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-d0153ddc-f521-4391-9b74-056a0a99c420 req-1d9811c9-c45e-44b1-98fc-7d1432c135e8 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:51.742634 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-d0153ddc-f521-4391-9b74-056a0a99c420 req-1d9811c9-c45e-44b1-98fc-7d1432c135e8 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:51.754439 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-d0153ddc-f521-4391-9b74-056a0a99c420 req-1d9811c9-c45e-44b1-98fc-7d1432c135e8 service nova] Creating event network-changed:5ae85da6-bc81-47ad-9baf-b2583a2b801b for instance 56cf74eb-5098-47e8-b99c-efd0af892b66 on hv-cinder-maste Sep 11 00:59:51.762469 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-d0153ddc-f521-4391-9b74-056a0a99c420 req-1d9811c9-c45e-44b1-98fc-7d1432c135e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035365 Sep 11 00:59:51.763098 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 270/531] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:52.020712 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c5d8a487-1f17-4e25-b1d4-705810abcdb5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:52.021937 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c5d8a487-1f17-4e25-b1d4-705810abcdb5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:52.029104 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5d8a487-1f17-4e25-b1d4-705810abcdb5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:52.029676 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5d8a487-1f17-4e25-b1d4-705810abcdb5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:52.030095 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5d8a487-1f17-4e25-b1d4-705810abcdb5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:52.030845 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5d8a487-1f17-4e25-b1d4-705810abcdb5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:52.031356 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5d8a487-1f17-4e25-b1d4-705810abcdb5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:52.031771 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c5d8a487-1f17-4e25-b1d4-705810abcdb5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:52.049371 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-c5d8a487-1f17-4e25-b1d4-705810abcdb5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] HTTP exception thrown: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c5d8a487-1f17-4e25-b1d4-705810abcdb5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Request method failure captured: Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 HTTP/1.1 Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTITt4T2abfRbSHNmV3mi1G_mltPD_SmXsVqGjT_oyfiTTuEpRzqwVCnltn5E8kEaDuMfnjUm_YRUTZcl2dqICbbszOPsNep-KuDpbVRIKHN-2x3z6qFFiAjbdYa1LDuw2Fq2ZpVdV6rnGOCcDXYQQv5M7me2xmd20agwuf3PHH1fXU Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 1bf8c10e733e485f9ac63769727b7151 Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 00:59:52.052061 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 00:59:52.053774 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1bf8c10e733e485f9ac63769727b7151", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 00:59:52.053774 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 00:59:52.053774 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 1bf8c10e733e485f9ac63769727b7151 Sep 11 00:59:52.053774 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 00:59:52.053774 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-AttachVolumeShelveTestJSON-279194813-project Sep 11 00:59:52.053774 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 00:59:52.053774 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 00:59:52.053774 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 44c365d540894a908b34fe51d854e96e Sep 11 00:59:52.053774 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeShelveTestJSON-279194813-project Sep 11 00:59:52.053774 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 00:59:52.053774 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 00:59:52.053774 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': '185afbdf-74f7-4a54-8ba8-58e7b6fd2e73'} Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 00:59:52.054578 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 00:59:52.056317 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 00:59:52.057718 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c5d8a487-1f17-4e25-b1d4-705810abcdb5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Returning 404 to user: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 00:59:52.057718 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c5d8a487-1f17-4e25-b1d4-705810abcdb5 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 404 len: 111 microversion: 2.20 time: 0.037209 Sep 11 00:59:52.057718 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 262/532] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:59:52 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 00:59:52.063875 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8d9040e5-da88-41ce-8cf5-7a083a96edb1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '.version_select at 0x7fbb9088e940>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:52.083704 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8d9040e5-da88-41ce-8cf5-7a083a96edb1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-484697336" status: 204 len: 0 microversion: 2.20 time: 0.024108 Sep 11 00:59:52.084289 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 271/533] 10.222.0.23 () {60 vars in 1259 bytes} [Sun Sep 11 00:59:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-484697336 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 00:59:52.789570 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9e81f4c1-3283-4dab-a46c-02c688bf5632 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Action: 'create', calling method: .version_select at 0x7fbb90762310>, body: {"keypair": {"name": "tempest-keypair-123209165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/FY5IYpy25OAeTiN+hz/XXw3ORcRLEueDOyC7j/NyDy2jGYtOVKVI1ON/fP0BAxRlusGsyJptP3IgymkQesSfhrOi2eF3CXgje9/xDZH2j9SGi/NPPYX+KEKd0WkLZSQ=="}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:52.810433 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-9e81f4c1-3283-4dab-a46c-02c688bf5632 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Getting quotas for project 1bf8c10e733e485f9ac63769727b7151. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:59:52.814800 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-9e81f4c1-3283-4dab-a46c-02c688bf5632 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Getting quotas for user 44c365d540894a908b34fe51d854e96e and project 1bf8c10e733e485f9ac63769727b7151. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:59:52.845650 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9e81f4c1-3283-4dab-a46c-02c688bf5632 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.059748 Sep 11 00:59:52.846583 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 263/534] 10.222.0.23 () {62 vars in 1200 bytes} [Sun Sep 11 00:59:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 11 00:59:53.130494 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-90a07495-a167-4b5f-aa19-02711b8d9ffd req-309e38c8-aa03-4094-aeb3-4d25b2427145 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "892e2654-c985-4d90-963a-4e418d86d162", "create_info": {"type": "qcow2", "new_file": "volume-892e2654-c985-4d90-963a-4e418d86d162.089f98ec-9f47-45d9-a27c-3ca5f2056e4c.vhdx", "snapshot_id": "089f98ec-9f47-45d9-a27c-3ca5f2056e4c"}}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:53.133668 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-90a07495-a167-4b5f-aa19-02711b8d9ffd req-309e38c8-aa03-4094-aeb3-4d25b2427145 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:53.134145 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-90a07495-a167-4b5f-aa19-02711b8d9ffd req-309e38c8-aa03-4094-aeb3-4d25b2427145 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:53.134571 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-90a07495-a167-4b5f-aa19-02711b8d9ffd req-309e38c8-aa03-4094-aeb3-4d25b2427145 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:53.143949 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-90a07495-a167-4b5f-aa19-02711b8d9ffd req-309e38c8-aa03-4094-aeb3-4d25b2427145 admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:53.144673 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-90a07495-a167-4b5f-aa19-02711b8d9ffd req-309e38c8-aa03-4094-aeb3-4d25b2427145 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:53.145094 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-90a07495-a167-4b5f-aa19-02711b8d9ffd req-309e38c8-aa03-4094-aeb3-4d25b2427145 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:53.168060 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-90a07495-a167-4b5f-aa19-02711b8d9ffd req-309e38c8-aa03-4094-aeb3-4d25b2427145 admin admin] 10.222.0.46 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.093139 Sep 11 00:59:53.168887 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 272/535] 10.222.0.46 () {64 vars in 1326 bytes} [Sun Sep 11 00:59:53 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 00:59:53.783896 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-155f97de-ba46-4348-814a-e9db31bdd419 req-90e0d1f6-bc93-4317-842d-3adfe3c2b97a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56cf74eb-5098-47e8-b99c-efd0af892b66", "tag": "5ae85da6-bc81-47ad-9baf-b2583a2b801b"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:53.795401 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-155f97de-ba46-4348-814a-e9db31bdd419 req-90e0d1f6-bc93-4317-842d-3adfe3c2b97a service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:53.795880 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-155f97de-ba46-4348-814a-e9db31bdd419 req-90e0d1f6-bc93-4317-842d-3adfe3c2b97a service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:53.796302 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-155f97de-ba46-4348-814a-e9db31bdd419 req-90e0d1f6-bc93-4317-842d-3adfe3c2b97a service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:53.807393 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-155f97de-ba46-4348-814a-e9db31bdd419 req-90e0d1f6-bc93-4317-842d-3adfe3c2b97a service nova] Creating event network-changed:5ae85da6-bc81-47ad-9baf-b2583a2b801b for instance 56cf74eb-5098-47e8-b99c-efd0af892b66 on hv-cinder-maste Sep 11 00:59:53.812541 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-155f97de-ba46-4348-814a-e9db31bdd419 req-90e0d1f6-bc93-4317-842d-3adfe3c2b97a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032339 Sep 11 00:59:53.813128 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 264/536] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 00:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 00:59:54.199787 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-31926694", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f977a90a-6e82-460e-bc39-8812d8dfe3bd"}], "security_groups": [{"name": "tempest-securitygroup--1898448237"}], "key_name": "tempest-keypair-123209165", "user_data": "}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 00:59:54.330006 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.network.neutron [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] validate_networks() for [('f977a90a-6e82-460e-bc39-8812d8dfe3bd', None, None, None, None, None)] {{(pid=120497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 00:59:54.745101 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Flavor limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 00:59:54.745460 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Image limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 00:59:54.745922 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Flavor pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 00:59:54.746324 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Image pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 00:59:54.747647 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 00:59:54.756760 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:54.757232 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:54.757657 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:54.758374 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:54.758815 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:54.759256 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:54.775715 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Getting quotas for project 1bf8c10e733e485f9ac63769727b7151. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 00:59:54.779723 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Getting quotas for user 44c365d540894a908b34fe51d854e96e and project 1bf8c10e733e485f9ac63769727b7151. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 00:59:54.791526 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Going to run 1 instances... {{(pid=120497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 00:59:54.793921 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 00:59:54.841066 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-821dcbe1-f576-4476-9fd7-aee40b72c545 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.649521 Sep 11 00:59:54.841713 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 273/537] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Sep 11 00:59:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 11 00:59:54.854587 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-85dfe3ba-8438-4d08-9b13-8aa7c58feccb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:54.855459 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-85dfe3ba-8438-4d08-9b13-8aa7c58feccb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:54.912350 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-85dfe3ba-8438-4d08-9b13-8aa7c58feccb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:54.922877 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-85dfe3ba-8438-4d08-9b13-8aa7c58feccb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:54.924770 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-85dfe3ba-8438-4d08-9b13-8aa7c58feccb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:54.925940 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-85dfe3ba-8438-4d08-9b13-8aa7c58feccb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1279 microversion: 2.20 time: 0.076491 Sep 11 00:59:54.927134 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 265/538] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:59:54 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1279 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:59:55.950423 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-af1adb04-6470-413b-af44-ac7a22216227 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:55.951054 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-af1adb04-6470-413b-af44-ac7a22216227 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:55.958462 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af1adb04-6470-413b-af44-ac7a22216227 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:55.959306 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af1adb04-6470-413b-af44-ac7a22216227 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:55.959524 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af1adb04-6470-413b-af44-ac7a22216227 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:55.960131 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af1adb04-6470-413b-af44-ac7a22216227 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:55.960567 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af1adb04-6470-413b-af44-ac7a22216227 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:55.960978 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af1adb04-6470-413b-af44-ac7a22216227 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:56.025981 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-af1adb04-6470-413b-af44-ac7a22216227 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:56.036530 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-af1adb04-6470-413b-af44-ac7a22216227 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:56.038054 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-af1adb04-6470-413b-af44-ac7a22216227 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:56.039171 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-af1adb04-6470-413b-af44-ac7a22216227 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1331 microversion: 2.20 time: 0.093247 Sep 11 00:59:56.039752 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 274/539] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:59:55 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:59:56.196865 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-f741bc37-00b1-4b46-867d-d44b7803d63f req-fe858b0d-4f12-41de-845e-72815302a448 admin admin] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:56.200188 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-f741bc37-00b1-4b46-867d-d44b7803d63f req-fe858b0d-4f12-41de-845e-72815302a448 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:56.200862 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-f741bc37-00b1-4b46-867d-d44b7803d63f req-fe858b0d-4f12-41de-845e-72815302a448 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:56.201297 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-f741bc37-00b1-4b46-867d-d44b7803d63f req-fe858b0d-4f12-41de-845e-72815302a448 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:56.210705 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-f741bc37-00b1-4b46-867d-d44b7803d63f req-fe858b0d-4f12-41de-845e-72815302a448 admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:56.211209 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-f741bc37-00b1-4b46-867d-d44b7803d63f req-fe858b0d-4f12-41de-845e-72815302a448 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:56.211653 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-f741bc37-00b1-4b46-867d-d44b7803d63f req-fe858b0d-4f12-41de-845e-72815302a448 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:56.226171 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-f741bc37-00b1-4b46-867d-d44b7803d63f req-fe858b0d-4f12-41de-845e-72815302a448 admin admin] 10.222.0.46 "DELETE /compute/v2.1/os-assisted-volume-snapshots/089f98ec-9f47-45d9-a27c-3ca5f2056e4c?delete_info=%7B%22file_to_merge%22:%20%22volume-892e2654-c985-4d90-963a-4e418d86d162.089f98ec-9f47-45d9-a27c-3ca5f2056e4c.vhdx%22,%20%22volume_id%22:%20%22892e2654-c985-4d90-963a-4e418d86d162%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.087732 Sep 11 00:59:56.226721 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 266/540] 10.222.0.46 () {62 vars in 1800 bytes} [Sun Sep 11 00:59:56 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/089f98ec-9f47-45d9-a27c-3ca5f2056e4c?delete_info=%7B%22file_to_merge%22:%20%22volume-892e2654-c985-4d90-963a-4e418d86d162.089f98ec-9f47-45d9-a27c-3ca5f2056e4c.vhdx%22,%20%22volume_id%22:%20%22892e2654-c985-4d90-963a-4e418d86d162%22%7D => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 00:59:57.067844 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-fa1b0a39-f7d3-485e-be9f-1a51082f47b3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:57.068773 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-fa1b0a39-f7d3-485e-be9f-1a51082f47b3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:57.075700 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa1b0a39-f7d3-485e-be9f-1a51082f47b3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:57.076174 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa1b0a39-f7d3-485e-be9f-1a51082f47b3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:57.076628 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa1b0a39-f7d3-485e-be9f-1a51082f47b3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:57.077285 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa1b0a39-f7d3-485e-be9f-1a51082f47b3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:57.077871 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa1b0a39-f7d3-485e-be9f-1a51082f47b3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:57.078276 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fa1b0a39-f7d3-485e-be9f-1a51082f47b3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:57.373415 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-fa1b0a39-f7d3-485e-be9f-1a51082f47b3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:57.382623 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-fa1b0a39-f7d3-485e-be9f-1a51082f47b3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:57.384779 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-fa1b0a39-f7d3-485e-be9f-1a51082f47b3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:57.386236 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-fa1b0a39-f7d3-485e-be9f-1a51082f47b3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1339 microversion: 2.20 time: 0.324928 Sep 11 00:59:57.386918 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 275/541] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:59:57 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1339 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:59:58.416200 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fe7354d3-e1d0-4d51-9dd3-13b12d4c3e12 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:58.416787 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-fe7354d3-e1d0-4d51-9dd3-13b12d4c3e12 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:58.423113 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe7354d3-e1d0-4d51-9dd3-13b12d4c3e12 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:58.423630 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe7354d3-e1d0-4d51-9dd3-13b12d4c3e12 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:58.424061 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe7354d3-e1d0-4d51-9dd3-13b12d4c3e12 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:58.424759 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe7354d3-e1d0-4d51-9dd3-13b12d4c3e12 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:58.425206 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe7354d3-e1d0-4d51-9dd3-13b12d4c3e12 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:58.425623 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe7354d3-e1d0-4d51-9dd3-13b12d4c3e12 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:58.489230 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-fe7354d3-e1d0-4d51-9dd3-13b12d4c3e12 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:58.498064 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-fe7354d3-e1d0-4d51-9dd3-13b12d4c3e12 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:58.499571 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-fe7354d3-e1d0-4d51-9dd3-13b12d4c3e12 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:58.500708 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-fe7354d3-e1d0-4d51-9dd3-13b12d4c3e12 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1337 microversion: 2.20 time: 0.090053 Sep 11 00:59:58.501272 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 267/542] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:59:58 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1337 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 00:59:59.533758 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-9e59e7a0-545f-488c-bd1b-c61b54b6f4c2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 00:59:59.534628 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-9e59e7a0-545f-488c-bd1b-c61b54b6f4c2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 00:59:59.545777 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9e59e7a0-545f-488c-bd1b-c61b54b6f4c2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:59.546569 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9e59e7a0-545f-488c-bd1b-c61b54b6f4c2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:59.547302 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9e59e7a0-545f-488c-bd1b-c61b54b6f4c2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:59.548478 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9e59e7a0-545f-488c-bd1b-c61b54b6f4c2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 00:59:59.549225 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9e59e7a0-545f-488c-bd1b-c61b54b6f4c2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 00:59:59.549926 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9e59e7a0-545f-488c-bd1b-c61b54b6f4c2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 00:59:59.624610 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-9e59e7a0-545f-488c-bd1b-c61b54b6f4c2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:59.637366 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-9e59e7a0-545f-488c-bd1b-c61b54b6f4c2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:59.639808 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-9e59e7a0-545f-488c-bd1b-c61b54b6f4c2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 00:59:59.641585 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-9e59e7a0-545f-488c-bd1b-c61b54b6f4c2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1337 microversion: 2.20 time: 0.114256 Sep 11 00:59:59.642490 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 276/543] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 00:59:59 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1337 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:00:00.667203 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0d5b8112-d6ec-4ba7-8a0e-b809614922ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:00.668599 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0d5b8112-d6ec-4ba7-8a0e-b809614922ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:00.675627 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d5b8112-d6ec-4ba7-8a0e-b809614922ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:00.676753 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d5b8112-d6ec-4ba7-8a0e-b809614922ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:00.677357 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d5b8112-d6ec-4ba7-8a0e-b809614922ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:00.678387 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d5b8112-d6ec-4ba7-8a0e-b809614922ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:00.678888 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d5b8112-d6ec-4ba7-8a0e-b809614922ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:00.679346 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d5b8112-d6ec-4ba7-8a0e-b809614922ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:00.887395 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0d5b8112-d6ec-4ba7-8a0e-b809614922ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:00.889702 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:00.897823 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0d5b8112-d6ec-4ba7-8a0e-b809614922ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:00.899281 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0d5b8112-d6ec-4ba7-8a0e-b809614922ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:00.900426 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0d5b8112-d6ec-4ba7-8a0e-b809614922ad tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1405 microversion: 2.20 time: 0.238213 Sep 11 01:00:00.901302 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 268/544] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:00:00 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:00:01.434793 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-c8b6757b-7b9e-4e15-808a-148c3af42491 req-7fcc9e45-351d-4be4-aec7-c6f76156052f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff12074-d8b0-4beb-9ddb-6e617f654908", "tag": "e1f950b8-4e34-4132-8dba-e46621d7902f"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:01.445928 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c8b6757b-7b9e-4e15-808a-148c3af42491 req-7fcc9e45-351d-4be4-aec7-c6f76156052f service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:01.446626 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c8b6757b-7b9e-4e15-808a-148c3af42491 req-7fcc9e45-351d-4be4-aec7-c6f76156052f service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:01.447542 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c8b6757b-7b9e-4e15-808a-148c3af42491 req-7fcc9e45-351d-4be4-aec7-c6f76156052f service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:01.460127 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-c8b6757b-7b9e-4e15-808a-148c3af42491 req-7fcc9e45-351d-4be4-aec7-c6f76156052f service nova] Creating event network-changed:e1f950b8-4e34-4132-8dba-e46621d7902f for instance bff12074-d8b0-4beb-9ddb-6e617f654908 on hv-cinder-maste Sep 11 01:00:01.465658 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-c8b6757b-7b9e-4e15-808a-148c3af42491 req-7fcc9e45-351d-4be4-aec7-c6f76156052f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034629 Sep 11 01:00:01.466580 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 269/545] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:00:01.473382 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-3a4a94ac-42ac-4127-ad51-c07e9fa030e9 req-02ab9ec9-4e40-4fec-b585-5ac55e626ab0 admin admin] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:01.476737 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-3a4a94ac-42ac-4127-ad51-c07e9fa030e9 req-02ab9ec9-4e40-4fec-b585-5ac55e626ab0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:01.477215 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-3a4a94ac-42ac-4127-ad51-c07e9fa030e9 req-02ab9ec9-4e40-4fec-b585-5ac55e626ab0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:01.477678 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-3a4a94ac-42ac-4127-ad51-c07e9fa030e9 req-02ab9ec9-4e40-4fec-b585-5ac55e626ab0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:01.489102 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-3a4a94ac-42ac-4127-ad51-c07e9fa030e9 req-02ab9ec9-4e40-4fec-b585-5ac55e626ab0 admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:01.489597 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-3a4a94ac-42ac-4127-ad51-c07e9fa030e9 req-02ab9ec9-4e40-4fec-b585-5ac55e626ab0 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:01.490120 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-3a4a94ac-42ac-4127-ad51-c07e9fa030e9 req-02ab9ec9-4e40-4fec-b585-5ac55e626ab0 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:01.505454 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-3a4a94ac-42ac-4127-ad51-c07e9fa030e9 req-02ab9ec9-4e40-4fec-b585-5ac55e626ab0 admin admin] 10.222.0.46 "DELETE /compute/v2.1/os-assisted-volume-snapshots/3fb83e4c-f65b-4b90-921d-2a7679c5e73e?delete_info=%7B%22file_to_merge%22:%20%22volume-892e2654-c985-4d90-963a-4e418d86d162.3fb83e4c-f65b-4b90-921d-2a7679c5e73e.vhdx%22,%20%22volume_id%22:%20%22892e2654-c985-4d90-963a-4e418d86d162%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.095058 Sep 11 01:00:01.506133 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 277/546] 10.222.0.46 () {62 vars in 1800 bytes} [Sun Sep 11 01:00:01 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/3fb83e4c-f65b-4b90-921d-2a7679c5e73e?delete_info=%7B%22file_to_merge%22:%20%22volume-892e2654-c985-4d90-963a-4e418d86d162.3fb83e4c-f65b-4b90-921d-2a7679c5e73e.vhdx%22,%20%22volume_id%22:%20%22892e2654-c985-4d90-963a-4e418d86d162%22%7D => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 01:00:01.928835 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-240e97a5-7ae8-4f67-8078-15d159491dc3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:01.929517 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-240e97a5-7ae8-4f67-8078-15d159491dc3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:01.936215 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-240e97a5-7ae8-4f67-8078-15d159491dc3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:01.936698 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-240e97a5-7ae8-4f67-8078-15d159491dc3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:01.937129 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-240e97a5-7ae8-4f67-8078-15d159491dc3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:01.937818 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-240e97a5-7ae8-4f67-8078-15d159491dc3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:01.938267 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-240e97a5-7ae8-4f67-8078-15d159491dc3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:01.938726 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-240e97a5-7ae8-4f67-8078-15d159491dc3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:02.078603 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-240e97a5-7ae8-4f67-8078-15d159491dc3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:02.087118 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-240e97a5-7ae8-4f67-8078-15d159491dc3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:02.088612 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-240e97a5-7ae8-4f67-8078-15d159491dc3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:02.089725 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-240e97a5-7ae8-4f67-8078-15d159491dc3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1405 microversion: 2.20 time: 0.166854 Sep 11 01:00:02.090301 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 270/547] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:00:01 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:00:03.118849 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-195a5a1b-9809-4114-82f3-b55b3dab3c81 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:03.119670 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-195a5a1b-9809-4114-82f3-b55b3dab3c81 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:03.127903 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-195a5a1b-9809-4114-82f3-b55b3dab3c81 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:03.128460 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-195a5a1b-9809-4114-82f3-b55b3dab3c81 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:03.128961 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-195a5a1b-9809-4114-82f3-b55b3dab3c81 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:03.129755 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-195a5a1b-9809-4114-82f3-b55b3dab3c81 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:03.130271 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-195a5a1b-9809-4114-82f3-b55b3dab3c81 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:03.130799 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-195a5a1b-9809-4114-82f3-b55b3dab3c81 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:03.272693 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-195a5a1b-9809-4114-82f3-b55b3dab3c81 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:03.280903 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-195a5a1b-9809-4114-82f3-b55b3dab3c81 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:03.282428 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-195a5a1b-9809-4114-82f3-b55b3dab3c81 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:03.283568 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-195a5a1b-9809-4114-82f3-b55b3dab3c81 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1405 microversion: 2.20 time: 0.170629 Sep 11 01:00:03.284159 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 278/548] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:00:03 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:00:04.313019 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3c3da8f7-7eca-4a40-b5ea-26f32f032e98 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:04.313895 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3c3da8f7-7eca-4a40-b5ea-26f32f032e98 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:04.322923 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c3da8f7-7eca-4a40-b5ea-26f32f032e98 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:04.323439 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c3da8f7-7eca-4a40-b5ea-26f32f032e98 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:04.323866 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c3da8f7-7eca-4a40-b5ea-26f32f032e98 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:04.324552 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c3da8f7-7eca-4a40-b5ea-26f32f032e98 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:04.325026 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c3da8f7-7eca-4a40-b5ea-26f32f032e98 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:04.325442 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c3da8f7-7eca-4a40-b5ea-26f32f032e98 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:04.469405 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3c3da8f7-7eca-4a40-b5ea-26f32f032e98 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:04.478437 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3c3da8f7-7eca-4a40-b5ea-26f32f032e98 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:04.479922 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3c3da8f7-7eca-4a40-b5ea-26f32f032e98 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:04.481088 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3c3da8f7-7eca-4a40-b5ea-26f32f032e98 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1405 microversion: 2.20 time: 0.174697 Sep 11 01:00:04.481860 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 271/549] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:00:04 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:00:04.644731 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-000e4dce-34bd-4bc8-b29c-cdee92fa277b req-b6083da3-4d91-4c00-9cc1-9dc0bca57594 admin admin] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:04.649185 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-000e4dce-34bd-4bc8-b29c-cdee92fa277b req-b6083da3-4d91-4c00-9cc1-9dc0bca57594 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:04.649765 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-000e4dce-34bd-4bc8-b29c-cdee92fa277b req-b6083da3-4d91-4c00-9cc1-9dc0bca57594 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:04.650264 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-000e4dce-34bd-4bc8-b29c-cdee92fa277b req-b6083da3-4d91-4c00-9cc1-9dc0bca57594 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:04.658727 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-000e4dce-34bd-4bc8-b29c-cdee92fa277b req-b6083da3-4d91-4c00-9cc1-9dc0bca57594 admin admin] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:04.659229 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-000e4dce-34bd-4bc8-b29c-cdee92fa277b req-b6083da3-4d91-4c00-9cc1-9dc0bca57594 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:04.659650 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-000e4dce-34bd-4bc8-b29c-cdee92fa277b req-b6083da3-4d91-4c00-9cc1-9dc0bca57594 admin admin] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:04.673653 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-000e4dce-34bd-4bc8-b29c-cdee92fa277b req-b6083da3-4d91-4c00-9cc1-9dc0bca57594 admin admin] 10.222.0.46 "DELETE /compute/v2.1/os-assisted-volume-snapshots/854ce204-1e4d-4066-88cf-c82439fc648e?delete_info=%7B%22file_to_merge%22:%20%22volume-892e2654-c985-4d90-963a-4e418d86d162.854ce204-1e4d-4066-88cf-c82439fc648e.vhdx%22,%20%22volume_id%22:%20%22892e2654-c985-4d90-963a-4e418d86d162%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.080592 Sep 11 01:00:04.674259 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 279/550] 10.222.0.46 () {62 vars in 1800 bytes} [Sun Sep 11 01:00:04 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/854ce204-1e4d-4066-88cf-c82439fc648e?delete_info=%7B%22file_to_merge%22:%20%22volume-892e2654-c985-4d90-963a-4e418d86d162.854ce204-1e4d-4066-88cf-c82439fc648e.vhdx%22,%20%22volume_id%22:%20%22892e2654-c985-4d90-963a-4e418d86d162%22%7D => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 01:00:05.509018 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-17614c67-06b3-46eb-b8a2-4f547b4462bf tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:05.509735 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-17614c67-06b3-46eb-b8a2-4f547b4462bf tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:05.517061 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=6 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:05.519872 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17614c67-06b3-46eb-b8a2-4f547b4462bf tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:05.520372 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17614c67-06b3-46eb-b8a2-4f547b4462bf tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:05.521049 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17614c67-06b3-46eb-b8a2-4f547b4462bf tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:05.522041 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17614c67-06b3-46eb-b8a2-4f547b4462bf tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:05.522849 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17614c67-06b3-46eb-b8a2-4f547b4462bf tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:05.523438 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17614c67-06b3-46eb-b8a2-4f547b4462bf tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:05.678136 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-17614c67-06b3-46eb-b8a2-4f547b4462bf tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:05.686649 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-17614c67-06b3-46eb-b8a2-4f547b4462bf tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:05.688131 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-17614c67-06b3-46eb-b8a2-4f547b4462bf tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:05.689270 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-17614c67-06b3-46eb-b8a2-4f547b4462bf tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1405 microversion: 2.20 time: 0.186255 Sep 11 01:00:05.689854 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 272/551] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:00:05 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:00:06.711399 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=6 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:06.717027 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-36a8d3a7-1d30-4fef-833b-b3b0542ce1e8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:06.717937 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-36a8d3a7-1d30-4fef-833b-b3b0542ce1e8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:06.724786 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36a8d3a7-1d30-4fef-833b-b3b0542ce1e8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:06.725335 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36a8d3a7-1d30-4fef-833b-b3b0542ce1e8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:06.725811 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36a8d3a7-1d30-4fef-833b-b3b0542ce1e8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:06.726564 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36a8d3a7-1d30-4fef-833b-b3b0542ce1e8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:06.727048 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36a8d3a7-1d30-4fef-833b-b3b0542ce1e8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:06.727545 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36a8d3a7-1d30-4fef-833b-b3b0542ce1e8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:06.945026 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-36a8d3a7-1d30-4fef-833b-b3b0542ce1e8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:06.953775 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-36a8d3a7-1d30-4fef-833b-b3b0542ce1e8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:06.955333 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-36a8d3a7-1d30-4fef-833b-b3b0542ce1e8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:06.956452 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-36a8d3a7-1d30-4fef-833b-b3b0542ce1e8 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1405 microversion: 2.20 time: 0.246064 Sep 11 01:00:06.957015 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 280/552] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:00:06 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:00:07.436336 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-50b0f517-2f9a-440c-ad64-e2579f69791d req-8ce3420c-8d5c-4774-9612-15d855335e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff12074-d8b0-4beb-9ddb-6e617f654908", "name": "network-vif-plugged", "status": "completed", "tag": "e1f950b8-4e34-4132-8dba-e46621d7902f"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:07.441264 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:07.448317 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-50b0f517-2f9a-440c-ad64-e2579f69791d req-8ce3420c-8d5c-4774-9612-15d855335e8b service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:07.448811 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-50b0f517-2f9a-440c-ad64-e2579f69791d req-8ce3420c-8d5c-4774-9612-15d855335e8b service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:07.449245 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-50b0f517-2f9a-440c-ad64-e2579f69791d req-8ce3420c-8d5c-4774-9612-15d855335e8b service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:07.461089 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-50b0f517-2f9a-440c-ad64-e2579f69791d req-8ce3420c-8d5c-4774-9612-15d855335e8b service nova] Creating event network-vif-plugged:e1f950b8-4e34-4132-8dba-e46621d7902f for instance bff12074-d8b0-4beb-9ddb-6e617f654908 on hv-cinder-maste Sep 11 01:00:07.466167 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-50b0f517-2f9a-440c-ad64-e2579f69791d req-8ce3420c-8d5c-4774-9612-15d855335e8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033550 Sep 11 01:00:07.466755 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 273/553] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:07.606655 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-7020b4c7-dc48-489f-a892-50be1c145d66 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:07.607274 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-7020b4c7-dc48-489f-a892-50be1c145d66 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:07.613963 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7020b4c7-dc48-489f-a892-50be1c145d66 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:07.614497 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7020b4c7-dc48-489f-a892-50be1c145d66 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:07.614967 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7020b4c7-dc48-489f-a892-50be1c145d66 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:07.615837 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7020b4c7-dc48-489f-a892-50be1c145d66 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:07.616283 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7020b4c7-dc48-489f-a892-50be1c145d66 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:07.616744 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7020b4c7-dc48-489f-a892-50be1c145d66 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:07.704028 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-7020b4c7-dc48-489f-a892-50be1c145d66 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lazy-loading 'services' on Instance uuid f34396ab-470f-47af-8d80-0bcd71d6bd36 {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:00:07.780800 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-7020b4c7-dc48-489f-a892-50be1c145d66 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36/os-volume_attachments/892e2654-c985-4d90-963a-4e418d86d162" status: 202 len: 0 microversion: 2.1 time: 0.177921 Sep 11 01:00:07.781488 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 281/554] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Sep 11 01:00:07 2022] DELETE /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36/os-volume_attachments/892e2654-c985-4d90-963a-4e418d86d162 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:00:07.986690 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8a67343d-4c39-4929-98fd-0d09506a4c85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:07.987774 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8a67343d-4c39-4929-98fd-0d09506a4c85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:07.998188 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a67343d-4c39-4929-98fd-0d09506a4c85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:07.998998 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a67343d-4c39-4929-98fd-0d09506a4c85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:07.999783 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a67343d-4c39-4929-98fd-0d09506a4c85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:08.000924 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a67343d-4c39-4929-98fd-0d09506a4c85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:08.001682 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a67343d-4c39-4929-98fd-0d09506a4c85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:08.002387 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a67343d-4c39-4929-98fd-0d09506a4c85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:08.142443 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8a67343d-4c39-4929-98fd-0d09506a4c85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:08.151171 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8a67343d-4c39-4929-98fd-0d09506a4c85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:08.152659 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8a67343d-4c39-4929-98fd-0d09506a4c85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:08.153765 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8a67343d-4c39-4929-98fd-0d09506a4c85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1405 microversion: 2.20 time: 0.174555 Sep 11 01:00:08.154336 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 274/555] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:00:07 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:00:09.182801 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-bec62983-a98d-4171-b688-fe2d1fbbed85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:09.183513 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-bec62983-a98d-4171-b688-fe2d1fbbed85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:09.190232 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bec62983-a98d-4171-b688-fe2d1fbbed85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:09.190704 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bec62983-a98d-4171-b688-fe2d1fbbed85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:09.191136 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bec62983-a98d-4171-b688-fe2d1fbbed85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:09.191846 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bec62983-a98d-4171-b688-fe2d1fbbed85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:09.192290 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bec62983-a98d-4171-b688-fe2d1fbbed85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:09.192704 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bec62983-a98d-4171-b688-fe2d1fbbed85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:09.337982 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-bec62983-a98d-4171-b688-fe2d1fbbed85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:09.346533 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-bec62983-a98d-4171-b688-fe2d1fbbed85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:09.348004 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-bec62983-a98d-4171-b688-fe2d1fbbed85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:09.349120 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-bec62983-a98d-4171-b688-fe2d1fbbed85 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1405 microversion: 2.20 time: 0.172912 Sep 11 01:00:09.349651 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 282/556] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:00:09 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:00:10.216388 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e5566a6d-3802-4378-9d0d-a38ccd2135b9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:10.218546 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e5566a6d-3802-4378-9d0d-a38ccd2135b9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:10.224454 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e5566a6d-3802-4378-9d0d-a38ccd2135b9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:10.224933 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e5566a6d-3802-4378-9d0d-a38ccd2135b9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:10.225359 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e5566a6d-3802-4378-9d0d-a38ccd2135b9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:10.226071 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e5566a6d-3802-4378-9d0d-a38ccd2135b9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:10.226521 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e5566a6d-3802-4378-9d0d-a38ccd2135b9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:10.226934 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e5566a6d-3802-4378-9d0d-a38ccd2135b9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:10.258484 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e5566a6d-3802-4378-9d0d-a38ccd2135b9 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047163 Sep 11 01:00:10.259122 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 275/557] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:00:10 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 01:00:10.324937 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-33451ade-cd81-417b-a457-8c5ea75f0072 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:10.325611 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-33451ade-cd81-417b-a457-8c5ea75f0072 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:10.332158 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-33451ade-cd81-417b-a457-8c5ea75f0072 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:10.332645 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-33451ade-cd81-417b-a457-8c5ea75f0072 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:10.333080 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-33451ade-cd81-417b-a457-8c5ea75f0072 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:10.333799 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-33451ade-cd81-417b-a457-8c5ea75f0072 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:10.334243 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-33451ade-cd81-417b-a457-8c5ea75f0072 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:10.334665 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-33451ade-cd81-417b-a457-8c5ea75f0072 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:10.360616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-33451ade-cd81-417b-a457-8c5ea75f0072 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Going to try to terminate instance {{(pid=120497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 01:00:10.373528 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0ba17dbc-7032-4081-a581-ebb148cc0f94 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:10.374229 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0ba17dbc-7032-4081-a581-ebb148cc0f94 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:10.380402 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0ba17dbc-7032-4081-a581-ebb148cc0f94 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:10.380996 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0ba17dbc-7032-4081-a581-ebb148cc0f94 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:10.381495 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0ba17dbc-7032-4081-a581-ebb148cc0f94 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:10.382259 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0ba17dbc-7032-4081-a581-ebb148cc0f94 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:10.382776 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0ba17dbc-7032-4081-a581-ebb148cc0f94 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:10.383287 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0ba17dbc-7032-4081-a581-ebb148cc0f94 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:10.438577 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-33451ade-cd81-417b-a457-8c5ea75f0072 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "DELETE /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 204 len: 0 microversion: 2.1 time: 0.117259 Sep 11 01:00:10.439429 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 283/558] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:00:10 2022] DELETE /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 01:00:10.448808 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b00fbb3f-cb5c-4522-a5dc-dc2d4e9cd20e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:10.449595 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-b00fbb3f-cb5c-4522-a5dc-dc2d4e9cd20e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:10.456256 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b00fbb3f-cb5c-4522-a5dc-dc2d4e9cd20e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:10.456748 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b00fbb3f-cb5c-4522-a5dc-dc2d4e9cd20e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:10.457184 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b00fbb3f-cb5c-4522-a5dc-dc2d4e9cd20e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:10.457917 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b00fbb3f-cb5c-4522-a5dc-dc2d4e9cd20e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:10.458369 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b00fbb3f-cb5c-4522-a5dc-dc2d4e9cd20e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:10.458806 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b00fbb3f-cb5c-4522-a5dc-dc2d4e9cd20e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:10.578661 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0ba17dbc-7032-4081-a581-ebb148cc0f94 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:10.587515 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0ba17dbc-7032-4081-a581-ebb148cc0f94 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:10.588954 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0ba17dbc-7032-4081-a581-ebb148cc0f94 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:10.590107 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0ba17dbc-7032-4081-a581-ebb148cc0f94 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1596 microversion: 2.20 time: 0.220620 Sep 11 01:00:10.590654 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 276/559] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:00:10 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1596 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 01:00:10.614127 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f8e4348a-038c-4a60-b181-dbaf069fb2e0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:10.614608 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f8e4348a-038c-4a60-b181-dbaf069fb2e0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:10.620854 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8e4348a-038c-4a60-b181-dbaf069fb2e0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:10.621230 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-b00fbb3f-cb5c-4522-a5dc-dc2d4e9cd20e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:10.621358 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8e4348a-038c-4a60-b181-dbaf069fb2e0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:10.621742 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8e4348a-038c-4a60-b181-dbaf069fb2e0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:10.622440 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8e4348a-038c-4a60-b181-dbaf069fb2e0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:10.622881 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8e4348a-038c-4a60-b181-dbaf069fb2e0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:10.623350 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8e4348a-038c-4a60-b181-dbaf069fb2e0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:10.629368 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-b00fbb3f-cb5c-4522-a5dc-dc2d4e9cd20e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1672 microversion: 2.1 time: 0.185495 Sep 11 01:00:10.629942 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 284/560] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:10 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1672 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:00:10.702972 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f8e4348a-038c-4a60-b181-dbaf069fb2e0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092624 Sep 11 01:00:10.703632 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 277/561] 10.222.0.23 () {60 vars in 1316 bytes} [Sun Sep 11 01:00:10 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 01:00:11.034936 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6c4b1569-5b18-4847-8887-bd8cd7d7ff83 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:11.035450 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6c4b1569-5b18-4847-8887-bd8cd7d7ff83 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:11.042166 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6c4b1569-5b18-4847-8887-bd8cd7d7ff83 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:11.042655 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6c4b1569-5b18-4847-8887-bd8cd7d7ff83 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:11.043067 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6c4b1569-5b18-4847-8887-bd8cd7d7ff83 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:11.043789 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6c4b1569-5b18-4847-8887-bd8cd7d7ff83 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:11.044233 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6c4b1569-5b18-4847-8887-bd8cd7d7ff83 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:11.044657 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6c4b1569-5b18-4847-8887-bd8cd7d7ff83 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:11.072940 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6c4b1569-5b18-4847-8887-bd8cd7d7ff83 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Going to try to terminate instance {{(pid=120497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 01:00:11.098037 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:11.154160 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6c4b1569-5b18-4847-8887-bd8cd7d7ff83 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 204 len: 0 microversion: 2.1 time: 0.122880 Sep 11 01:00:11.155054 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 285/562] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:00:11 2022] DELETE /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 01:00:11.165471 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-44371913-1b67-4c2d-bd66-0b9c8cfa2505 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:11.166633 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-44371913-1b67-4c2d-bd66-0b9c8cfa2505 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:11.172989 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44371913-1b67-4c2d-bd66-0b9c8cfa2505 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:11.173477 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44371913-1b67-4c2d-bd66-0b9c8cfa2505 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:11.173940 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44371913-1b67-4c2d-bd66-0b9c8cfa2505 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:11.174646 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44371913-1b67-4c2d-bd66-0b9c8cfa2505 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:11.175091 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44371913-1b67-4c2d-bd66-0b9c8cfa2505 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:11.175548 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44371913-1b67-4c2d-bd66-0b9c8cfa2505 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:11.311703 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-44371913-1b67-4c2d-bd66-0b9c8cfa2505 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:11.319892 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-44371913-1b67-4c2d-bd66-0b9c8cfa2505 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1514 microversion: 2.1 time: 0.158684 Sep 11 01:00:11.320485 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 278/563] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:11 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:11.661116 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a15c1b9a-db0f-4b4c-a7ec-c884bd32409f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:11.662438 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a15c1b9a-db0f-4b4c-a7ec-c884bd32409f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:11.665254 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:11.671607 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a15c1b9a-db0f-4b4c-a7ec-c884bd32409f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:11.672373 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a15c1b9a-db0f-4b4c-a7ec-c884bd32409f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:11.672821 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a15c1b9a-db0f-4b4c-a7ec-c884bd32409f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:11.673585 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a15c1b9a-db0f-4b4c-a7ec-c884bd32409f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:11.674062 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a15c1b9a-db0f-4b4c-a7ec-c884bd32409f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:11.674665 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a15c1b9a-db0f-4b4c-a7ec-c884bd32409f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:11.694539 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-c07aa9f6-3ff4-4aea-b7cd-84a7840b66f7 req-37c1d845-fab4-4f32-97fc-daba7d627709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff12074-d8b0-4beb-9ddb-6e617f654908", "tag": "e1f950b8-4e34-4132-8dba-e46621d7902f"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:11.704780 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c07aa9f6-3ff4-4aea-b7cd-84a7840b66f7 req-37c1d845-fab4-4f32-97fc-daba7d627709 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:11.705250 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c07aa9f6-3ff4-4aea-b7cd-84a7840b66f7 req-37c1d845-fab4-4f32-97fc-daba7d627709 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:11.705903 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c07aa9f6-3ff4-4aea-b7cd-84a7840b66f7 req-37c1d845-fab4-4f32-97fc-daba7d627709 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:11.718787 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-c07aa9f6-3ff4-4aea-b7cd-84a7840b66f7 req-37c1d845-fab4-4f32-97fc-daba7d627709 service nova] Creating event network-changed:e1f950b8-4e34-4132-8dba-e46621d7902f for instance bff12074-d8b0-4beb-9ddb-6e617f654908 on hv-cinder-maste Sep 11 01:00:11.724198 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-c07aa9f6-3ff4-4aea-b7cd-84a7840b66f7 req-37c1d845-fab4-4f32-97fc-daba7d627709 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033285 Sep 11 01:00:11.725077 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 279/564] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:00:11.817596 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a15c1b9a-db0f-4b4c-a7ec-c884bd32409f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:11.828291 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a15c1b9a-db0f-4b4c-a7ec-c884bd32409f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1672 microversion: 2.1 time: 0.178216 Sep 11 01:00:11.828882 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 286/565] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:11 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:00:12.344255 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ba353e74-7e09-43d6-b860-87bfb21caedd tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:12.345728 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ba353e74-7e09-43d6-b860-87bfb21caedd tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:12.352341 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba353e74-7e09-43d6-b860-87bfb21caedd tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:12.352823 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba353e74-7e09-43d6-b860-87bfb21caedd tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:12.353362 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba353e74-7e09-43d6-b860-87bfb21caedd tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:12.354067 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba353e74-7e09-43d6-b860-87bfb21caedd tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:12.354614 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba353e74-7e09-43d6-b860-87bfb21caedd tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:12.355034 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba353e74-7e09-43d6-b860-87bfb21caedd tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:12.496498 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-ba353e74-7e09-43d6-b860-87bfb21caedd tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:12.507509 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ba353e74-7e09-43d6-b860-87bfb21caedd tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1514 microversion: 2.1 time: 0.167908 Sep 11 01:00:12.508701 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 280/566] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:12 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:12.856536 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-078aab8c-913d-4e01-9d8e-922f21502e76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:12.857273 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-078aab8c-913d-4e01-9d8e-922f21502e76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:12.867061 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-078aab8c-913d-4e01-9d8e-922f21502e76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:12.867865 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-078aab8c-913d-4e01-9d8e-922f21502e76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:12.868293 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-078aab8c-913d-4e01-9d8e-922f21502e76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:12.869318 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-078aab8c-913d-4e01-9d8e-922f21502e76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:12.870092 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-078aab8c-913d-4e01-9d8e-922f21502e76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:12.870688 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-078aab8c-913d-4e01-9d8e-922f21502e76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:13.013319 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-078aab8c-913d-4e01-9d8e-922f21502e76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:13.021436 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-078aab8c-913d-4e01-9d8e-922f21502e76 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1672 microversion: 2.1 time: 0.173465 Sep 11 01:00:13.022280 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 287/567] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:12 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:13.531522 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-78a2fdd7-a78a-401c-8303-c23a241589a0 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:13.532095 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-78a2fdd7-a78a-401c-8303-c23a241589a0 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:13.539128 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78a2fdd7-a78a-401c-8303-c23a241589a0 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:13.539639 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78a2fdd7-a78a-401c-8303-c23a241589a0 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:13.540422 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78a2fdd7-a78a-401c-8303-c23a241589a0 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:13.541177 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78a2fdd7-a78a-401c-8303-c23a241589a0 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:13.541620 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78a2fdd7-a78a-401c-8303-c23a241589a0 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:13.542035 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78a2fdd7-a78a-401c-8303-c23a241589a0 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:13.694340 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-78a2fdd7-a78a-401c-8303-c23a241589a0 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:13.702757 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-78a2fdd7-a78a-401c-8303-c23a241589a0 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1514 microversion: 2.1 time: 0.175297 Sep 11 01:00:13.703381 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 281/568] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:13 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:14.044716 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0235a404-eae5-4c30-b32c-a9818579fd3c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:14.045308 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-0235a404-eae5-4c30-b32c-a9818579fd3c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:14.052182 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0235a404-eae5-4c30-b32c-a9818579fd3c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:14.052664 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0235a404-eae5-4c30-b32c-a9818579fd3c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:14.053072 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0235a404-eae5-4c30-b32c-a9818579fd3c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:14.053788 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0235a404-eae5-4c30-b32c-a9818579fd3c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:14.054238 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0235a404-eae5-4c30-b32c-a9818579fd3c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:14.054655 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0235a404-eae5-4c30-b32c-a9818579fd3c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:14.196333 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0235a404-eae5-4c30-b32c-a9818579fd3c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:14.204854 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0235a404-eae5-4c30-b32c-a9818579fd3c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1672 microversion: 2.1 time: 0.164120 Sep 11 01:00:14.205437 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 288/569] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:14 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:14.726547 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4d496618-69f1-40a5-8fd8-c5cdf5747116 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:14.727164 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4d496618-69f1-40a5-8fd8-c5cdf5747116 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:14.734532 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d496618-69f1-40a5-8fd8-c5cdf5747116 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:14.735014 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d496618-69f1-40a5-8fd8-c5cdf5747116 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:14.735459 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d496618-69f1-40a5-8fd8-c5cdf5747116 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:14.736181 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d496618-69f1-40a5-8fd8-c5cdf5747116 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:14.736620 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d496618-69f1-40a5-8fd8-c5cdf5747116 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:14.737035 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d496618-69f1-40a5-8fd8-c5cdf5747116 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:14.872224 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4d496618-69f1-40a5-8fd8-c5cdf5747116 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:14.880834 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4d496618-69f1-40a5-8fd8-c5cdf5747116 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1514 microversion: 2.1 time: 0.158215 Sep 11 01:00:14.881458 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 282/570] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:14 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:15.234545 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-310141ca-080f-4189-a39b-487775582e97 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:15.235146 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-310141ca-080f-4189-a39b-487775582e97 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:15.237107 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=10 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:15.243911 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-310141ca-080f-4189-a39b-487775582e97 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:15.244402 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-310141ca-080f-4189-a39b-487775582e97 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:15.244830 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-310141ca-080f-4189-a39b-487775582e97 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:15.245529 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-310141ca-080f-4189-a39b-487775582e97 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:15.245978 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-310141ca-080f-4189-a39b-487775582e97 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:15.246388 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-310141ca-080f-4189-a39b-487775582e97 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:15.381933 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-310141ca-080f-4189-a39b-487775582e97 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:15.390879 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-310141ca-080f-4189-a39b-487775582e97 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1672 microversion: 2.1 time: 0.160459 Sep 11 01:00:15.391499 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 289/571] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:15 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:15.905327 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-cf236875-f1c3-497e-be37-571355342383 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:15.905966 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-cf236875-f1c3-497e-be37-571355342383 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:15.916808 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf236875-f1c3-497e-be37-571355342383 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:15.917272 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf236875-f1c3-497e-be37-571355342383 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:15.917878 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf236875-f1c3-497e-be37-571355342383 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:15.918899 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf236875-f1c3-497e-be37-571355342383 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:15.919560 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf236875-f1c3-497e-be37-571355342383 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:15.920104 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf236875-f1c3-497e-be37-571355342383 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:16.058510 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-cf236875-f1c3-497e-be37-571355342383 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:16.071310 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-cf236875-f1c3-497e-be37-571355342383 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1514 microversion: 2.1 time: 0.170502 Sep 11 01:00:16.072148 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 283/572] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:15 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:16.417846 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6b63da73-0398-4b42-bafc-6c3d5737277b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:16.418437 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6b63da73-0398-4b42-bafc-6c3d5737277b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:16.425255 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6b63da73-0398-4b42-bafc-6c3d5737277b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:16.425745 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6b63da73-0398-4b42-bafc-6c3d5737277b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:16.426181 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6b63da73-0398-4b42-bafc-6c3d5737277b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:16.426878 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6b63da73-0398-4b42-bafc-6c3d5737277b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:16.427379 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6b63da73-0398-4b42-bafc-6c3d5737277b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:16.427809 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6b63da73-0398-4b42-bafc-6c3d5737277b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:16.571843 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6b63da73-0398-4b42-bafc-6c3d5737277b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:16.580231 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6b63da73-0398-4b42-bafc-6c3d5737277b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1672 microversion: 2.1 time: 0.168185 Sep 11 01:00:16.580773 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 290/573] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:16 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:17.100642 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-894aa684-8485-4538-a20a-89205c745bb9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:17.101268 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-894aa684-8485-4538-a20a-89205c745bb9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:17.109195 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-894aa684-8485-4538-a20a-89205c745bb9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:17.109695 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-894aa684-8485-4538-a20a-89205c745bb9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:17.110134 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-894aa684-8485-4538-a20a-89205c745bb9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:17.110854 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-894aa684-8485-4538-a20a-89205c745bb9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:17.111352 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-894aa684-8485-4538-a20a-89205c745bb9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:17.111781 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-894aa684-8485-4538-a20a-89205c745bb9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:17.254049 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-894aa684-8485-4538-a20a-89205c745bb9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:17.264143 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-894aa684-8485-4538-a20a-89205c745bb9 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1514 microversion: 2.1 time: 0.167536 Sep 11 01:00:17.264737 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 284/574] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:17 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:17.605510 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-62d87094-b391-4bf1-bf7e-87a8c25f21a6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:17.606114 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-62d87094-b391-4bf1-bf7e-87a8c25f21a6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:17.613064 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-62d87094-b391-4bf1-bf7e-87a8c25f21a6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:17.613552 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-62d87094-b391-4bf1-bf7e-87a8c25f21a6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:17.614257 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-62d87094-b391-4bf1-bf7e-87a8c25f21a6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:17.614961 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-62d87094-b391-4bf1-bf7e-87a8c25f21a6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:17.615416 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-62d87094-b391-4bf1-bf7e-87a8c25f21a6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:17.615829 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-62d87094-b391-4bf1-bf7e-87a8c25f21a6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:17.759742 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-62d87094-b391-4bf1-bf7e-87a8c25f21a6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:17.768186 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-62d87094-b391-4bf1-bf7e-87a8c25f21a6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1672 microversion: 2.1 time: 0.167436 Sep 11 01:00:17.768767 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 291/575] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:17 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:18.288099 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-20dcb2d0-0969-4555-a160-f5cbca147492 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:18.289406 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-20dcb2d0-0969-4555-a160-f5cbca147492 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:18.292025 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-de020274-df73-4204-9458-4d459a3084ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:18.292656 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-de020274-df73-4204-9458-4d459a3084ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:18.297738 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:18.299029 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-de020274-df73-4204-9458-4d459a3084ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:18.299600 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-de020274-df73-4204-9458-4d459a3084ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:18.301449 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-de020274-df73-4204-9458-4d459a3084ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:18.301593 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20dcb2d0-0969-4555-a160-f5cbca147492 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:18.301593 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20dcb2d0-0969-4555-a160-f5cbca147492 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:18.301766 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-de020274-df73-4204-9458-4d459a3084ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:18.301849 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20dcb2d0-0969-4555-a160-f5cbca147492 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:18.301938 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-de020274-df73-4204-9458-4d459a3084ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:18.301938 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-de020274-df73-4204-9458-4d459a3084ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:18.302872 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20dcb2d0-0969-4555-a160-f5cbca147492 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:18.303574 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20dcb2d0-0969-4555-a160-f5cbca147492 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:18.304187 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20dcb2d0-0969-4555-a160-f5cbca147492 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:18.338570 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-20dcb2d0-0969-4555-a160-f5cbca147492 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/ips" status: 200 len: 151 microversion: 2.1 time: 0.054945 Sep 11 01:00:18.339528 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 285/576] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Sep 11 01:00:18 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/ips => generated 151 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:18.795737 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e3b84153-09eb-421b-bd80-3f624ea84aac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:18.795737 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e3b84153-09eb-421b-bd80-3f624ea84aac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:18.801630 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3b84153-09eb-421b-bd80-3f624ea84aac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:18.802430 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3b84153-09eb-421b-bd80-3f624ea84aac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:18.802869 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3b84153-09eb-421b-bd80-3f624ea84aac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:18.803653 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3b84153-09eb-421b-bd80-3f624ea84aac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:18.804111 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3b84153-09eb-421b-bd80-3f624ea84aac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:18.804536 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3b84153-09eb-421b-bd80-3f624ea84aac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:18.858700 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-de020274-df73-4204-9458-4d459a3084ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:18.866888 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-de020274-df73-4204-9458-4d459a3084ee tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1514 microversion: 2.1 time: 0.581574 Sep 11 01:00:18.867671 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 292/577] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:18 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1514 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:00:18.904927 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e3b84153-09eb-421b-bd80-3f624ea84aac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:18.920122 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e3b84153-09eb-421b-bd80-3f624ea84aac tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1604 microversion: 2.1 time: 0.131135 Sep 11 01:00:18.921070 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 286/578] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:18 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1604 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:19.328751 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-d21a3cc6-0890-449b-999a-23b695d74bb0 req-08474672-f3a3-4b82-96cc-45a40c2e162f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34396ab-470f-47af-8d80-0bcd71d6bd36", "name": "network-vif-deleted", "tag": "c85f56d0-288e-4e3d-abc7-3ca802d5eb06"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:19.340231 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-d21a3cc6-0890-449b-999a-23b695d74bb0 req-08474672-f3a3-4b82-96cc-45a40c2e162f service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:19.340921 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-d21a3cc6-0890-449b-999a-23b695d74bb0 req-08474672-f3a3-4b82-96cc-45a40c2e162f service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:19.341320 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-d21a3cc6-0890-449b-999a-23b695d74bb0 req-08474672-f3a3-4b82-96cc-45a40c2e162f service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:19.354983 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-d21a3cc6-0890-449b-999a-23b695d74bb0 req-08474672-f3a3-4b82-96cc-45a40c2e162f service nova] Creating event network-vif-deleted:c85f56d0-288e-4e3d-abc7-3ca802d5eb06 for instance f34396ab-470f-47af-8d80-0bcd71d6bd36 on hv-cinder-maste Sep 11 01:00:19.365667 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-d21a3cc6-0890-449b-999a-23b695d74bb0 req-08474672-f3a3-4b82-96cc-45a40c2e162f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042159 Sep 11 01:00:19.365995 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-d7afa70b-89a6-4aba-b8b5-1016b4bd9fd4 req-6fab5d5b-44b6-4486-98bd-ec08738e55ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11702158-2435-4d46-9e27-7ff56d83bca8", "name": "network-vif-deleted", "tag": "6083c5ea-ec25-4a93-b7ff-4971543ff629"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:19.372952 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 293/579] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:19.380322 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d7afa70b-89a6-4aba-b8b5-1016b4bd9fd4 req-6fab5d5b-44b6-4486-98bd-ec08738e55ce service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:19.380855 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d7afa70b-89a6-4aba-b8b5-1016b4bd9fd4 req-6fab5d5b-44b6-4486-98bd-ec08738e55ce service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:19.381402 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d7afa70b-89a6-4aba-b8b5-1016b4bd9fd4 req-6fab5d5b-44b6-4486-98bd-ec08738e55ce service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:19.393358 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-d7afa70b-89a6-4aba-b8b5-1016b4bd9fd4 req-6fab5d5b-44b6-4486-98bd-ec08738e55ce service nova] Creating event network-vif-deleted:6083c5ea-ec25-4a93-b7ff-4971543ff629 for instance 11702158-2435-4d46-9e27-7ff56d83bca8 on hv-cinder-maste Sep 11 01:00:19.398263 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-d7afa70b-89a6-4aba-b8b5-1016b4bd9fd4 req-6fab5d5b-44b6-4486-98bd-ec08738e55ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037636 Sep 11 01:00:19.399118 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 287/580] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:00:19.756213 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-045718bc-e91f-4a59-87c3-a0847b6f3963 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f668eba-c81e-46cd-8840-ebc3ab4305a9"}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:19.759222 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-045718bc-e91f-4a59-87c3-a0847b6f3963 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:19.766443 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-045718bc-e91f-4a59-87c3-a0847b6f3963 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:19.766928 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-045718bc-e91f-4a59-87c3-a0847b6f3963 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:19.767379 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-045718bc-e91f-4a59-87c3-a0847b6f3963 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:19.768067 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-045718bc-e91f-4a59-87c3-a0847b6f3963 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:19.768618 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-045718bc-e91f-4a59-87c3-a0847b6f3963 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:19.769094 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-045718bc-e91f-4a59-87c3-a0847b6f3963 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:19.895158 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ff8f4ee1-5b9d-44ff-a74a-384b1bb48f67 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:19.895896 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ff8f4ee1-5b9d-44ff-a74a-384b1bb48f67 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:19.902658 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff8f4ee1-5b9d-44ff-a74a-384b1bb48f67 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:19.903625 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff8f4ee1-5b9d-44ff-a74a-384b1bb48f67 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:19.904122 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff8f4ee1-5b9d-44ff-a74a-384b1bb48f67 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:19.904887 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff8f4ee1-5b9d-44ff-a74a-384b1bb48f67 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:19.905370 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff8f4ee1-5b9d-44ff-a74a-384b1bb48f67 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:19.905792 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff8f4ee1-5b9d-44ff-a74a-384b1bb48f67 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:19.941268 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff8f4ee1-5b9d-44ff-a74a-384b1bb48f67 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:19.941736 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff8f4ee1-5b9d-44ff-a74a-384b1bb48f67 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:19.942182 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff8f4ee1-5b9d-44ff-a74a-384b1bb48f67 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:19.942633 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-ff8f4ee1-5b9d-44ff-a74a-384b1bb48f67 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lazy-loading 'fault' on Instance uuid f34396ab-470f-47af-8d80-0bcd71d6bd36 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:00:19.945095 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:19.993690 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-ff8f4ee1-5b9d-44ff-a74a-384b1bb48f67 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9626cd8bd4341ba7d26e76f34b533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20163c9fb6a5490f9ad676ac84fe411b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:20.001721 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ff8f4ee1-5b9d-44ff-a74a-384b1bb48f67 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 200 len: 1308 microversion: 2.1 time: 0.111305 Sep 11 01:00:20.002301 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 288/581] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:19 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:20.012315 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-54c2c1d9-b13d-4856-9ef7-bca46531105d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:20.013021 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-54c2c1d9-b13d-4856-9ef7-bca46531105d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:20.019455 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54c2c1d9-b13d-4856-9ef7-bca46531105d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:20.019950 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54c2c1d9-b13d-4856-9ef7-bca46531105d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:20.020382 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54c2c1d9-b13d-4856-9ef7-bca46531105d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:20.021080 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54c2c1d9-b13d-4856-9ef7-bca46531105d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:20.021532 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54c2c1d9-b13d-4856-9ef7-bca46531105d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:20.021949 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54c2c1d9-b13d-4856-9ef7-bca46531105d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:20.055893 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54c2c1d9-b13d-4856-9ef7-bca46531105d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:20.056497 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54c2c1d9-b13d-4856-9ef7-bca46531105d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:20.056939 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54c2c1d9-b13d-4856-9ef7-bca46531105d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:20.057393 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-54c2c1d9-b13d-4856-9ef7-bca46531105d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lazy-loading 'fault' on Instance uuid 11702158-2435-4d46-9e27-7ff56d83bca8 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:00:20.099966 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-54c2c1d9-b13d-4856-9ef7-bca46531105d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:20.109959 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-54c2c1d9-b13d-4856-9ef7-bca46531105d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 200 len: 1325 microversion: 2.1 time: 0.101460 Sep 11 01:00:20.110547 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 289/582] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:20 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 1325 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:20.377055 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-045718bc-e91f-4a59-87c3-a0847b6f3963 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "POST /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.626643 Sep 11 01:00:20.377855 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 294/583] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Sep 11 01:00:19 2022] POST /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/os-volume_attachments => generated 194 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:21.025381 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5c423db0-f44b-4883-abad-3dd866179619 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:21.026032 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5c423db0-f44b-4883-abad-3dd866179619 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] [instance: f34396ab-470f-47af-8d80-0bcd71d6bd36] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:21.032700 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5c423db0-f44b-4883-abad-3dd866179619 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:21.033177 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5c423db0-f44b-4883-abad-3dd866179619 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:21.033597 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5c423db0-f44b-4883-abad-3dd866179619 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:21.034287 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5c423db0-f44b-4883-abad-3dd866179619 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:21.034736 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5c423db0-f44b-4883-abad-3dd866179619 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:21.035154 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5c423db0-f44b-4883-abad-3dd866179619 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:21.051645 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-5c423db0-f44b-4883-abad-3dd866179619 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] HTTP exception thrown: Instance f34396ab-470f-47af-8d80-0bcd71d6bd36 could not be found. Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5c423db0-f44b-4883-abad-3dd866179619 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Request method failure captured: Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 HTTP/1.1 Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTKTI3IO_Ig3NlC3G2JsEkmLnAcV_BgBNUv7gCuBRb7Hz_qusXQaq_kWgf1pb1lKjJHYxKw3qPW660n42--hLRmVd_Yzps0YXqBTxBHbA_0cE0rIfxLilEKBf377zjXCcWA9cz2l9PFYtmn0-4tKiz4FiWZjNd9azeultBAMUaMtxaw Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 20163c9fb6a5490f9ad676ac84fe411b Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1219202710 Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:00:21.053250 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:00:21.055686 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20163c9fb6a5490f9ad676ac84fe411b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20163c9fb6a5490f9ad676ac84fe411b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20163c9fb6a5490f9ad676ac84fe411b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20163c9fb6a5490f9ad676ac84fe411b", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:00:21.055686 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-VolumesSnapshotTestJSON-1219202710 Sep 11 01:00:21.055686 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 20163c9fb6a5490f9ad676ac84fe411b Sep 11 01:00:21.055686 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1219202710 Sep 11 01:00:21.055686 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-VolumesSnapshotTestJSON-1219202710-project Sep 11 01:00:21.055686 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:00:21.055686 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:00:21.055686 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 6ca9626cd8bd4341ba7d26e76f34b533 Sep 11 01:00:21.055686 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-VolumesSnapshotTestJSON-1219202710-project Sep 11 01:00:21.055686 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:00:21.055686 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance f34396ab-470f-47af-8d80-0bcd71d6bd36 could not be found. Sep 11 01:00:21.055686 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': 'f34396ab-470f-47af-8d80-0bcd71d6bd36'} Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f34396ab-470f-47af-8d80-0bcd71d6bd36 could not be found. Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:00:21.057028 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f34396ab-470f-47af-8d80-0bcd71d6bd36 could not be found. Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f34396ab-470f-47af-8d80-0bcd71d6bd36 could not be found. Sep 11 01:00:21.059469 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:21.061802 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5c423db0-f44b-4883-abad-3dd866179619 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] Returning 404 to user: Instance f34396ab-470f-47af-8d80-0bcd71d6bd36 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:00:21.061802 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5c423db0-f44b-4883-abad-3dd866179619 tempest-VolumesSnapshotTestJSON-1219202710 tempest-VolumesSnapshotTestJSON-1219202710-project] 10.222.0.23 "GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36" status: 404 len: 111 microversion: 2.1 time: 0.033580 Sep 11 01:00:21.061802 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 290/584] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:21 2022] GET /compute/v2.1/servers/f34396ab-470f-47af-8d80-0bcd71d6bd36 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:00:21.134547 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-46574c5f-ea31-4195-8126-564b3fb191c6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:21.135251 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-46574c5f-ea31-4195-8126-564b3fb191c6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:21.142638 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-46574c5f-ea31-4195-8126-564b3fb191c6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:21.143436 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-46574c5f-ea31-4195-8126-564b3fb191c6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:21.143864 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-46574c5f-ea31-4195-8126-564b3fb191c6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:21.144733 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-46574c5f-ea31-4195-8126-564b3fb191c6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:21.145182 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-46574c5f-ea31-4195-8126-564b3fb191c6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:21.145606 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-46574c5f-ea31-4195-8126-564b3fb191c6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:21.161132 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-46574c5f-ea31-4195-8126-564b3fb191c6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] HTTP exception thrown: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-46574c5f-ea31-4195-8126-564b3fb191c6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Request method failure captured: Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 HTTP/1.1 Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTIatU_rUWvJEnf3ctReKwprorKx05nzV7nHw_OTBlBxETZeTyg0kxFYPpH2M0OOy-RufMmUSzoemhw45mD_uk5B5djfJSdIUzm9kQyDdjZocylxf_hiWpEA5xgC1ECqaIe1lR_NGPkxp_hCmmlRWk4hGgZyQFRS9saXvJyyOTusGd4 Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 4dec451848364c2787673580ec4c90c1 Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:00:21.162953 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:00:21.164311 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4dec451848364c2787673580ec4c90c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4dec451848364c2787673580ec4c90c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4dec451848364c2787673580ec4c90c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4dec451848364c2787673580ec4c90c1", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:00:21.164311 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:00:21.164311 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 4dec451848364c2787673580ec4c90c1 Sep 11 01:00:21.164311 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:00:21.164311 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-AttachVolumeTestJSON-612483322-project Sep 11 01:00:21.164311 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:00:21.164311 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:00:21.164311 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 081d365c7b15443aa76c7da2ca444a8e Sep 11 01:00:21.164311 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-AttachVolumeTestJSON-612483322-project Sep 11 01:00:21.164311 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 01:00:21.164311 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:00:21.164311 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': '11702158-2435-4d46-9e27-7ff56d83bca8'} Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:00:21.165447 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:00:21.166695 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:21.167780 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-46574c5f-ea31-4195-8126-564b3fb191c6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Returning 404 to user: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:00:21.167780 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-46574c5f-ea31-4195-8126-564b3fb191c6 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 404 len: 111 microversion: 2.1 time: 0.034751 Sep 11 01:00:21.167780 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 295/585] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:21 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:00:21.174047 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-620bcbf3-a9c4-49c2-b712-18b37c6cf16d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '.version_select at 0x7fbb90696790>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:21.193345 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-620bcbf3-a9c4-49c2-b712-18b37c6cf16d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-569059288" status: 202 len: 0 microversion: 2.1 time: 0.023030 Sep 11 01:00:21.194072 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 291/586] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Sep 11 01:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-569059288 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:00:21.887156 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-805c427f-858d-4725-962d-9f69ca4a1b4e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Action: 'create', calling method: .version_select at 0x7fbb9059ec10>, body: {"keypair": {"name": "tempest-keypair-538889960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkUhOPWaH7wV+GH84BlDO11by6X94eJNTUmpVF+88rBTPPbRaA5IJIqsjWeq69+sZPxxygjxIjipTZSdENPB3EDm0jGJ2pF4BUYqycNw6BMzQfcYaWZexlLDHWz2v80Ag=="}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:21.907374 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-805c427f-858d-4725-962d-9f69ca4a1b4e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Getting quotas for project 4dec451848364c2787673580ec4c90c1. Resources: {'key_pairs'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 01:00:21.912347 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-805c427f-858d-4725-962d-9f69ca4a1b4e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Getting quotas for user 081d365c7b15443aa76c7da2ca444a8e and project 4dec451848364c2787673580ec4c90c1. Resources: {'key_pairs'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 01:00:21.938028 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-805c427f-858d-4725-962d-9f69ca4a1b4e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057542 Sep 11 01:00:21.938647 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 296/587] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Sep 11 01:00:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:22.682595 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2364bfe0-2858-4c8d-8297-4113372f00b0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f668eba-c81e-46cd-8840-ebc3ab4305a9"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:22.684994 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2364bfe0-2858-4c8d-8297-4113372f00b0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:22.692102 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2364bfe0-2858-4c8d-8297-4113372f00b0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:22.692585 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2364bfe0-2858-4c8d-8297-4113372f00b0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:22.693016 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2364bfe0-2858-4c8d-8297-4113372f00b0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:22.694616 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2364bfe0-2858-4c8d-8297-4113372f00b0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:22.694616 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2364bfe0-2858-4c8d-8297-4113372f00b0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:22.694616 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2364bfe0-2858-4c8d-8297-4113372f00b0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:22.786481 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-2364bfe0-2858-4c8d-8297-4113372f00b0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] HTTP exception thrown: Invalid volume: volume 6f668eba-c81e-46cd-8840-ebc3ab4305a9 is already attached to instances: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2364bfe0-2858-4c8d-8297-4113372f00b0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Request method failure captured: Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: POST /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/os-volume_attachments HTTP/1.1 Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 74 Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIZleOaEuAlKtiWOzScZQy__ERdzmN_Fsh18R3AG3G89WR_08snWZ6YRxuVmBkd8e4eDOuVoSFmU4H1_ArYPdT3bBFelG_bNniDYHGShKUr5tzXt-fC8Pp-PdXsUGSAqFcgcXiUSGpT-d-6G18Ajvb77CCwyMx9RJWxLsZjcUQaDz8 Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:00:22.788131 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:00:22.789563 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89e6e6a587374d53b8515f264dfd8cb6", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:00:22.789563 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:00:22.789563 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:00:22.789563 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:00:22.789563 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:00:22.789563 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:00:22.789563 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:00:22.789563 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 364cf4a7a3bf4e70973c78a5d690e998 Sep 11 01:00:22.789563 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:00:22.789563 dv-cinder-master-3-smb devstack@n-api.service[120496]: Sep 11 01:00:22.789563 dv-cinder-master-3-smb devstack@n-api.service[120496]: {"volumeAttachment": {"volumeId": "6f668eba-c81e-46cd-8840-ebc3ab4305a9"}} Sep 11 01:00:22.789563 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Invalid volume: volume 6f668eba-c81e-46cd-8840-ebc3ab4305a9 is already attached to instances: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'server_id': '68ba728f-6c2a-4a9c-8f55-d87c0046b7b1', 'body': {'volumeAttachment': {'volumeId': '6f668eba-c81e-46cd-8840-ebc3ab4305a9'}}} Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6f668eba-c81e-46cd-8840-ebc3ab4305a9 is already attached to instances: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:22.790827 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6f668eba-c81e-46cd-8840-ebc3ab4305a9 is already attached to instances: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:22.792145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:00:22.793457 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:00:22.793457 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:00:22.793457 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:00:22.793457 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6f668eba-c81e-46cd-8840-ebc3ab4305a9 is already attached to instances: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 Sep 11 01:00:22.793457 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:22.793457 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2364bfe0-2858-4c8d-8297-4113372f00b0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Returning 400 to user: Invalid volume: volume 6f668eba-c81e-46cd-8840-ebc3ab4305a9 is already attached to instances: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:00:22.793457 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2364bfe0-2858-4c8d-8297-4113372f00b0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "POST /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111817 Sep 11 01:00:22.793457 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 292/588] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Sep 11 01:00:22 2022] POST /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 01:00:22.873873 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c02c20b6-24f3-47fa-bbb8-e43f1f474bb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:22.874462 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c02c20b6-24f3-47fa-bbb8-e43f1f474bb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:22.881729 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c02c20b6-24f3-47fa-bbb8-e43f1f474bb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:22.882312 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c02c20b6-24f3-47fa-bbb8-e43f1f474bb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:22.882823 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c02c20b6-24f3-47fa-bbb8-e43f1f474bb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:22.883541 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c02c20b6-24f3-47fa-bbb8-e43f1f474bb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:22.884087 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c02c20b6-24f3-47fa-bbb8-e43f1f474bb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:22.884541 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c02c20b6-24f3-47fa-bbb8-e43f1f474bb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:22.968386 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-c02c20b6-24f3-47fa-bbb8-e43f1f474bb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lazy-loading 'services' on Instance uuid 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:00:23.045474 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c02c20b6-24f3-47fa-bbb8-e43f1f474bb7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/os-volume_attachments/6f668eba-c81e-46cd-8840-ebc3ab4305a9" status: 202 len: 0 microversion: 2.1 time: 0.176260 Sep 11 01:00:23.046193 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 297/589] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Sep 11 01:00:22 2022] DELETE /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/os-volume_attachments/6f668eba-c81e-46cd-8840-ebc3ab4305a9 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:00:23.054896 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1cca3d7b-0da5-4ef7-8d96-35427a9a6fd9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:23.057370 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1cca3d7b-0da5-4ef7-8d96-35427a9a6fd9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:23.064701 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1cca3d7b-0da5-4ef7-8d96-35427a9a6fd9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:23.065379 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1cca3d7b-0da5-4ef7-8d96-35427a9a6fd9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:23.065961 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1cca3d7b-0da5-4ef7-8d96-35427a9a6fd9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:23.067135 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1cca3d7b-0da5-4ef7-8d96-35427a9a6fd9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:23.067684 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1cca3d7b-0da5-4ef7-8d96-35427a9a6fd9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:23.068181 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1cca3d7b-0da5-4ef7-8d96-35427a9a6fd9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:23.099273 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1cca3d7b-0da5-4ef7-8d96-35427a9a6fd9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048383 Sep 11 01:00:23.104730 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 293/590] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:00:23 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:23.357939 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1885781252", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab04b06f-ad0d-401a-9169-4aa7681cc0d9"}], "security_groups": [{"name": "tempest-securitygroup--1643831211"}], "key_name": "tempest-keypair-538889960", "user_data": "}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:23.484109 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.network.neutron [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] validate_networks() for [('ab04b06f-ad0d-401a-9169-4aa7681cc0d9', None, None, None, None, None)] {{(pid=120497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 01:00:23.890015 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Flavor limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 01:00:23.890372 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Image limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 01:00:23.890874 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Flavor pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 01:00:23.891329 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Image pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 01:00:23.891759 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 01:00:23.904085 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:23.904617 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:23.905289 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:23.906064 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:23.906578 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:23.907038 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:23.925140 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Getting quotas for project 4dec451848364c2787673580ec4c90c1. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 01:00:23.929061 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Getting quotas for user 081d365c7b15443aa76c7da2ca444a8e and project 4dec451848364c2787673580ec4c90c1. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 01:00:23.940267 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Going to run 1 instances... {{(pid=120497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 01:00:23.942999 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 01:00:24.001511 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-cfd765c2-37a5-40eb-bc23-6714f92ea784 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.648293 Sep 11 01:00:24.008302 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 298/591] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 01:00:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 01:00:24.014075 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5ee7749f-7a42-480a-a3b9-9728e2073842 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:24.014700 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5ee7749f-7a42-480a-a3b9-9728e2073842 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:24.088507 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-5ee7749f-7a42-480a-a3b9-9728e2073842 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:24.096066 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5ee7749f-7a42-480a-a3b9-9728e2073842 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1237 microversion: 2.1 time: 0.086468 Sep 11 01:00:24.096635 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 294/592] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:24 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:24.113150 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-db4963ed-8a65-4c7b-9442-2da200fed642 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:24.116272 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-db4963ed-8a65-4c7b-9442-2da200fed642 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:24.124837 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-db4963ed-8a65-4c7b-9442-2da200fed642 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:24.125329 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-db4963ed-8a65-4c7b-9442-2da200fed642 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:24.125762 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-db4963ed-8a65-4c7b-9442-2da200fed642 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:24.126464 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-db4963ed-8a65-4c7b-9442-2da200fed642 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:24.127307 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-db4963ed-8a65-4c7b-9442-2da200fed642 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:24.127765 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-db4963ed-8a65-4c7b-9442-2da200fed642 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:24.160099 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-db4963ed-8a65-4c7b-9442-2da200fed642 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052098 Sep 11 01:00:24.160661 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 299/593] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:00:24 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 01:00:24.227900 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-20ef957a-de57-4749-b08c-6637d6a1fbf7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:24.228755 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-20ef957a-de57-4749-b08c-6637d6a1fbf7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:24.235544 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20ef957a-de57-4749-b08c-6637d6a1fbf7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:24.236021 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20ef957a-de57-4749-b08c-6637d6a1fbf7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:24.236443 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20ef957a-de57-4749-b08c-6637d6a1fbf7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:24.237125 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20ef957a-de57-4749-b08c-6637d6a1fbf7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:24.237566 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20ef957a-de57-4749-b08c-6637d6a1fbf7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:24.237974 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20ef957a-de57-4749-b08c-6637d6a1fbf7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:24.268133 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-20ef957a-de57-4749-b08c-6637d6a1fbf7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 01:00:24.350435 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-20ef957a-de57-4749-b08c-6637d6a1fbf7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 204 len: 0 microversion: 2.1 time: 0.126475 Sep 11 01:00:24.351057 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 295/594] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:00:24 2022] DELETE /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 01:00:24.360129 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6493a7c4-0d15-4133-a2c0-3ccb5276419b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:24.360890 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6493a7c4-0d15-4133-a2c0-3ccb5276419b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:24.367266 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6493a7c4-0d15-4133-a2c0-3ccb5276419b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:24.367859 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6493a7c4-0d15-4133-a2c0-3ccb5276419b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:24.368792 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6493a7c4-0d15-4133-a2c0-3ccb5276419b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:24.369387 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6493a7c4-0d15-4133-a2c0-3ccb5276419b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:24.370027 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6493a7c4-0d15-4133-a2c0-3ccb5276419b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:24.370620 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6493a7c4-0d15-4133-a2c0-3ccb5276419b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:24.512159 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6493a7c4-0d15-4133-a2c0-3ccb5276419b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:24.520452 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6493a7c4-0d15-4133-a2c0-3ccb5276419b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1682 microversion: 2.1 time: 0.164541 Sep 11 01:00:24.521021 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 300/595] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:24 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:25.119133 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f8728aeb-9402-4d7b-90e0-752d42aa7482 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:25.119882 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f8728aeb-9402-4d7b-90e0-752d42aa7482 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:25.126508 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8728aeb-9402-4d7b-90e0-752d42aa7482 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:25.126999 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8728aeb-9402-4d7b-90e0-752d42aa7482 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:25.127539 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8728aeb-9402-4d7b-90e0-752d42aa7482 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:25.128229 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8728aeb-9402-4d7b-90e0-752d42aa7482 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:25.128672 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8728aeb-9402-4d7b-90e0-752d42aa7482 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:25.129610 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8728aeb-9402-4d7b-90e0-752d42aa7482 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:25.194927 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f8728aeb-9402-4d7b-90e0-752d42aa7482 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:25.204905 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f8728aeb-9402-4d7b-90e0-752d42aa7482 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1241 microversion: 2.1 time: 0.090024 Sep 11 01:00:25.212869 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 296/596] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:25 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:25.544913 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8e9d3c4b-9227-4139-ba03-3b3f4de10fad tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:25.545443 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-8e9d3c4b-9227-4139-ba03-3b3f4de10fad tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:25.552431 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8e9d3c4b-9227-4139-ba03-3b3f4de10fad tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:25.552976 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8e9d3c4b-9227-4139-ba03-3b3f4de10fad tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:25.553429 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8e9d3c4b-9227-4139-ba03-3b3f4de10fad tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:25.554215 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8e9d3c4b-9227-4139-ba03-3b3f4de10fad tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:25.554665 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8e9d3c4b-9227-4139-ba03-3b3f4de10fad tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:25.555097 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8e9d3c4b-9227-4139-ba03-3b3f4de10fad tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:25.699130 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8e9d3c4b-9227-4139-ba03-3b3f4de10fad tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:25.707660 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8e9d3c4b-9227-4139-ba03-3b3f4de10fad tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1682 microversion: 2.1 time: 0.166765 Sep 11 01:00:25.708227 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 301/597] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:25 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:26.230802 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f70f2d0d-c2eb-4535-a73e-9f999717922e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:26.231431 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f70f2d0d-c2eb-4535-a73e-9f999717922e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:26.240476 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f70f2d0d-c2eb-4535-a73e-9f999717922e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:26.241096 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f70f2d0d-c2eb-4535-a73e-9f999717922e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:26.241725 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f70f2d0d-c2eb-4535-a73e-9f999717922e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:26.242773 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f70f2d0d-c2eb-4535-a73e-9f999717922e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:26.243489 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f70f2d0d-c2eb-4535-a73e-9f999717922e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:26.243918 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f70f2d0d-c2eb-4535-a73e-9f999717922e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:26.313657 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f70f2d0d-c2eb-4535-a73e-9f999717922e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:26.321769 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f70f2d0d-c2eb-4535-a73e-9f999717922e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1233 microversion: 2.1 time: 0.095326 Sep 11 01:00:26.322359 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 297/598] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:26 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1233 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:26.732472 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0e52e24a-1053-418e-b550-b15c8c88d6f8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:26.733145 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-0e52e24a-1053-418e-b550-b15c8c88d6f8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:26.739929 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e52e24a-1053-418e-b550-b15c8c88d6f8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:26.740616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e52e24a-1053-418e-b550-b15c8c88d6f8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:26.741259 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e52e24a-1053-418e-b550-b15c8c88d6f8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:26.742007 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e52e24a-1053-418e-b550-b15c8c88d6f8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:26.742427 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e52e24a-1053-418e-b550-b15c8c88d6f8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:26.742846 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e52e24a-1053-418e-b550-b15c8c88d6f8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:26.758971 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:26.888001 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0e52e24a-1053-418e-b550-b15c8c88d6f8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:26.895857 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0e52e24a-1053-418e-b550-b15c8c88d6f8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1682 microversion: 2.1 time: 0.167527 Sep 11 01:00:26.896697 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 302/599] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:26 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:27.345082 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-c610e80e-9936-4882-880a-df646ecac524 req-42f3d2bf-7fef-409c-bb53-7ad82f9b43c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ba728f-6c2a-4a9c-8f55-d87c0046b7b1", "name": "network-vif-deleted", "tag": "70298aae-6b4c-46bf-9ebc-8c03965f50cf"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:27.345796 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-43691e3a-a194-45ef-8188-80cccee7b206 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:27.346677 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-43691e3a-a194-45ef-8188-80cccee7b206 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:27.354124 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-43691e3a-a194-45ef-8188-80cccee7b206 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:27.355254 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-43691e3a-a194-45ef-8188-80cccee7b206 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:27.356208 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-43691e3a-a194-45ef-8188-80cccee7b206 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:27.357473 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-43691e3a-a194-45ef-8188-80cccee7b206 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:27.358369 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-43691e3a-a194-45ef-8188-80cccee7b206 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:27.359205 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-43691e3a-a194-45ef-8188-80cccee7b206 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:27.360825 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c610e80e-9936-4882-880a-df646ecac524 req-42f3d2bf-7fef-409c-bb53-7ad82f9b43c6 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:27.362872 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c610e80e-9936-4882-880a-df646ecac524 req-42f3d2bf-7fef-409c-bb53-7ad82f9b43c6 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:27.363948 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c610e80e-9936-4882-880a-df646ecac524 req-42f3d2bf-7fef-409c-bb53-7ad82f9b43c6 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:27.384483 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-c610e80e-9936-4882-880a-df646ecac524 req-42f3d2bf-7fef-409c-bb53-7ad82f9b43c6 service nova] Creating event network-vif-deleted:70298aae-6b4c-46bf-9ebc-8c03965f50cf for instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 on hv-cinder-maste Sep 11 01:00:27.390286 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-c610e80e-9936-4882-880a-df646ecac524 req-42f3d2bf-7fef-409c-bb53-7ad82f9b43c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048790 Sep 11 01:00:27.394941 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 298/600] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:27.429911 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-43691e3a-a194-45ef-8188-80cccee7b206 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:27.438034 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-43691e3a-a194-45ef-8188-80cccee7b206 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1295 microversion: 2.1 time: 0.096631 Sep 11 01:00:27.445423 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 303/601] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:27 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:27.920846 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3a147295-8d88-405e-92d3-f5dc93f091d0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:27.921553 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3a147295-8d88-405e-92d3-f5dc93f091d0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:27.928026 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a147295-8d88-405e-92d3-f5dc93f091d0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:27.928527 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a147295-8d88-405e-92d3-f5dc93f091d0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:27.928943 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a147295-8d88-405e-92d3-f5dc93f091d0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:27.929877 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a147295-8d88-405e-92d3-f5dc93f091d0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:27.930499 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a147295-8d88-405e-92d3-f5dc93f091d0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:27.931065 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a147295-8d88-405e-92d3-f5dc93f091d0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:27.967002 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a147295-8d88-405e-92d3-f5dc93f091d0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:27.967936 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a147295-8d88-405e-92d3-f5dc93f091d0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:27.968378 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a147295-8d88-405e-92d3-f5dc93f091d0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:27.968828 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-3a147295-8d88-405e-92d3-f5dc93f091d0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lazy-loading 'fault' on Instance uuid 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:00:28.019098 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3a147295-8d88-405e-92d3-f5dc93f091d0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:28.027838 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3a147295-8d88-405e-92d3-f5dc93f091d0 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 200 len: 1330 microversion: 2.1 time: 0.111504 Sep 11 01:00:28.028443 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 299/602] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:27 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 1330 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:00:28.463453 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-024c64ea-23a2-4d70-bcf6-e570e0c70069 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:28.464709 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-024c64ea-23a2-4d70-bcf6-e570e0c70069 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:28.476718 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-024c64ea-23a2-4d70-bcf6-e570e0c70069 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:28.477498 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-024c64ea-23a2-4d70-bcf6-e570e0c70069 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:28.478120 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-024c64ea-23a2-4d70-bcf6-e570e0c70069 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:28.478819 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-024c64ea-23a2-4d70-bcf6-e570e0c70069 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:28.479294 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-024c64ea-23a2-4d70-bcf6-e570e0c70069 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:28.479715 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-024c64ea-23a2-4d70-bcf6-e570e0c70069 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:28.700813 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-024c64ea-23a2-4d70-bcf6-e570e0c70069 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:28.715312 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-024c64ea-23a2-4d70-bcf6-e570e0c70069 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1363 microversion: 2.1 time: 0.255356 Sep 11 01:00:28.716157 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 304/603] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:28 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:29.037010 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-4fa7bda8-5b46-40aa-82dd-c03e3be1e0fb req-6e9502f3-c34f-40a7-87dc-8a5ebc721bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb3eb557-558f-456d-83b2-23769926f3ca", "tag": "e9163d63-c63f-4164-9500-b11dcb2c600e"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:29.051109 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-4fa7bda8-5b46-40aa-82dd-c03e3be1e0fb req-6e9502f3-c34f-40a7-87dc-8a5ebc721bed service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:29.052701 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-4fa7bda8-5b46-40aa-82dd-c03e3be1e0fb req-6e9502f3-c34f-40a7-87dc-8a5ebc721bed service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:29.053167 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-822ac0e4-5cfa-4f8c-a109-83298444a88f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:29.053606 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-4fa7bda8-5b46-40aa-82dd-c03e3be1e0fb req-6e9502f3-c34f-40a7-87dc-8a5ebc721bed service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:29.054002 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-822ac0e4-5cfa-4f8c-a109-83298444a88f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:29.069557 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-822ac0e4-5cfa-4f8c-a109-83298444a88f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:29.070219 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-822ac0e4-5cfa-4f8c-a109-83298444a88f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:29.070598 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-4fa7bda8-5b46-40aa-82dd-c03e3be1e0fb req-6e9502f3-c34f-40a7-87dc-8a5ebc721bed service nova] Creating event network-changed:e9163d63-c63f-4164-9500-b11dcb2c600e for instance bb3eb557-558f-456d-83b2-23769926f3ca on hv-cinder-maste Sep 11 01:00:29.071060 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-822ac0e4-5cfa-4f8c-a109-83298444a88f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:29.072057 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-822ac0e4-5cfa-4f8c-a109-83298444a88f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:29.072714 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-822ac0e4-5cfa-4f8c-a109-83298444a88f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:29.073637 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-822ac0e4-5cfa-4f8c-a109-83298444a88f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:29.075972 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-4fa7bda8-5b46-40aa-82dd-c03e3be1e0fb req-6e9502f3-c34f-40a7-87dc-8a5ebc721bed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044066 Sep 11 01:00:29.077093 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 300/604] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:29.090504 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-822ac0e4-5cfa-4f8c-a109-83298444a88f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] HTTP exception thrown: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-822ac0e4-5cfa-4f8c-a109-83298444a88f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Request method failure captured: Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 HTTP/1.1 Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTIZleOaEuAlKtiWOzScZQy__ERdzmN_Fsh18R3AG3G89WR_08snWZ6YRxuVmBkd8e4eDOuVoSFmU4H1_ArYPdT3bBFelG_bNniDYHGShKUr5tzXt-fC8Pp-PdXsUGSAqFcgcXiUSGpT-d-6G18Ajvb77CCwyMx9RJWxLsZjcUQaDz8 Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:00:29.092279 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:00:29.093873 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89e6e6a587374d53b8515f264dfd8cb6", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:00:29.093873 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:00:29.093873 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:00:29.093873 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:00:29.093873 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:00:29.093873 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:00:29.093873 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:00:29.093873 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 364cf4a7a3bf4e70973c78a5d690e998 Sep 11 01:00:29.093873 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:00:29.093873 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 01:00:29.093873 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:00:29.093873 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': '68ba728f-6c2a-4a9c-8f55-d87c0046b7b1'} Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:00:29.094738 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:00:29.096361 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:29.097759 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-822ac0e4-5cfa-4f8c-a109-83298444a88f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Returning 404 to user: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:00:29.097759 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-822ac0e4-5cfa-4f8c-a109-83298444a88f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 404 len: 111 microversion: 2.1 time: 0.047473 Sep 11 01:00:29.112535 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 305/605] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:29 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:00:29.121761 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-056515ea-cdb1-4f44-b484-63cbdc0edb19 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '.version_select at 0x7fbb907681f0>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:29.148282 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-056515ea-cdb1-4f44-b484-63cbdc0edb19 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-454993795" status: 202 len: 0 microversion: 2.1 time: 0.030761 Sep 11 01:00:29.148972 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 301/606] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Sep 11 01:00:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-454993795 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 01:00:29.738300 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-41e6db9c-c860-44d1-b640-121e6e3d6ee7 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:29.739744 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-41e6db9c-c860-44d1-b640-121e6e3d6ee7 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:29.751097 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-41e6db9c-c860-44d1-b640-121e6e3d6ee7 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:29.751655 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-41e6db9c-c860-44d1-b640-121e6e3d6ee7 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:29.752141 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-41e6db9c-c860-44d1-b640-121e6e3d6ee7 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:29.752924 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-41e6db9c-c860-44d1-b640-121e6e3d6ee7 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:29.753413 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-41e6db9c-c860-44d1-b640-121e6e3d6ee7 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:29.753819 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-41e6db9c-c860-44d1-b640-121e6e3d6ee7 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:29.832703 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1dd43ffe-206e-4b63-9e80-b4ba6cdf47ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Action: 'create', calling method: .version_select at 0x7fbb906960d0>, body: {"keypair": {"name": "tempest-keypair-1008429077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6Q+H4hLUmumNWOmj+FqPpMHVv8Rz+eQkTb5N/LG5TdyyTJso4Gb0Rb50o+jkwOxL0wlm2IUdfls8fvImgww0Eo/SFWo3gTHhLE+YUToQ7zBlcCJLoTk3SL429zBGU7GA=="}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:29.848969 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-1dd43ffe-206e-4b63-9e80-b4ba6cdf47ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 01:00:29.853071 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-1dd43ffe-206e-4b63-9e80-b4ba6cdf47ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for user 364cf4a7a3bf4e70973c78a5d690e998 and project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 01:00:29.877024 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1dd43ffe-206e-4b63-9e80-b4ba6cdf47ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047930 Sep 11 01:00:29.877920 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 302/607] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Sep 11 01:00:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:29.899529 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-41e6db9c-c860-44d1-b640-121e6e3d6ee7 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:29.907551 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-41e6db9c-c860-44d1-b640-121e6e3d6ee7 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1363 microversion: 2.1 time: 0.173193 Sep 11 01:00:29.908134 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 306/608] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:29 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:30.930657 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e865ea8f-b37f-4036-9447-9fcb38eba3c8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:30.932207 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e865ea8f-b37f-4036-9447-9fcb38eba3c8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:30.938765 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e865ea8f-b37f-4036-9447-9fcb38eba3c8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:30.939285 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e865ea8f-b37f-4036-9447-9fcb38eba3c8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:30.939914 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e865ea8f-b37f-4036-9447-9fcb38eba3c8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:30.940626 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e865ea8f-b37f-4036-9447-9fcb38eba3c8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:30.941082 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e865ea8f-b37f-4036-9447-9fcb38eba3c8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:30.941486 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e865ea8f-b37f-4036-9447-9fcb38eba3c8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:31.174004 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-156222501", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "245b555a-f171-4b26-8562-bbe3df87effe"}], "security_groups": [{"name": "tempest-securitygroup--531246074"}], "key_name": "tempest-keypair-1008429077", "user_data": "}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:31.392569 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e865ea8f-b37f-4036-9447-9fcb38eba3c8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:31.400303 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.network.neutron [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] validate_networks() for [('245b555a-f171-4b26-8562-bbe3df87effe', None, None, None, None, None)] {{(pid=120497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 01:00:31.408396 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e865ea8f-b37f-4036-9447-9fcb38eba3c8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1363 microversion: 2.1 time: 0.481752 Sep 11 01:00:31.419277 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 303/609] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:30 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1363 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:00:31.822729 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Flavor limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 01:00:31.823157 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Image limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 01:00:31.823678 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Flavor pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 01:00:31.824288 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Image pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 01:00:31.824829 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 01:00:31.834594 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:31.835063 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:31.835525 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:31.836232 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:31.836684 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:31.837095 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:31.853437 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 01:00:31.858544 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Getting quotas for user 364cf4a7a3bf4e70973c78a5d690e998 and project 89e6e6a587374d53b8515f264dfd8cb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 01:00:31.869490 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Going to run 1 instances... {{(pid=120497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 01:00:31.871698 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 01:00:31.918874 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-eae13655-bb75-44dd-b863-706f0bd1fbd2 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.749363 Sep 11 01:00:31.919540 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 307/610] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 01:00:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 01:00:31.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-db6bd95c-9f27-43fc-84cb-1c15f54227c4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:31.931762 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-db6bd95c-9f27-43fc-84cb-1c15f54227c4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:31.996998 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-db6bd95c-9f27-43fc-84cb-1c15f54227c4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:32.004722 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-db6bd95c-9f27-43fc-84cb-1c15f54227c4 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1241 microversion: 2.1 time: 0.077497 Sep 11 01:00:32.005864 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 304/611] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:31 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:32.432314 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-365f4695-2b1a-48f1-bf05-d94bc7d5b042 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:32.433832 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-365f4695-2b1a-48f1-bf05-d94bc7d5b042 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:32.440393 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-365f4695-2b1a-48f1-bf05-d94bc7d5b042 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:32.440932 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-365f4695-2b1a-48f1-bf05-d94bc7d5b042 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:32.441458 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-365f4695-2b1a-48f1-bf05-d94bc7d5b042 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:32.442169 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-365f4695-2b1a-48f1-bf05-d94bc7d5b042 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:32.442598 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-365f4695-2b1a-48f1-bf05-d94bc7d5b042 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:32.443044 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-365f4695-2b1a-48f1-bf05-d94bc7d5b042 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:32.560950 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bd66ebc9-7715-499e-b556-e65df8bac97a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:32.561439 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bd66ebc9-7715-499e-b556-e65df8bac97a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:32.568741 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd66ebc9-7715-499e-b556-e65df8bac97a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:32.569224 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd66ebc9-7715-499e-b556-e65df8bac97a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:32.569651 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd66ebc9-7715-499e-b556-e65df8bac97a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:32.570348 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd66ebc9-7715-499e-b556-e65df8bac97a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:32.571018 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd66ebc9-7715-499e-b556-e65df8bac97a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:32.571459 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd66ebc9-7715-499e-b556-e65df8bac97a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:32.591739 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-365f4695-2b1a-48f1-bf05-d94bc7d5b042 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:32.599755 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-365f4695-2b1a-48f1-bf05-d94bc7d5b042 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1363 microversion: 2.1 time: 0.172000 Sep 11 01:00:32.600589 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 308/612] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:32 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:32.657662 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-bd66ebc9-7715-499e-b556-e65df8bac97a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lazy-loading 'services' on Instance uuid 56cf74eb-5098-47e8-b99c-efd0af892b66 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:00:32.737135 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bd66ebc9-7715-499e-b556-e65df8bac97a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "DELETE /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-volume_attachments/dcd0c282-d833-4270-960b-2089359ef810" status: 202 len: 0 microversion: 2.1 time: 0.180671 Sep 11 01:00:32.746874 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 305/613] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Sep 11 01:00:32 2022] DELETE /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-volume_attachments/dcd0c282-d833-4270-960b-2089359ef810 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:00:32.758927 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a815b422-ee92-4115-b46f-b5c34776cac7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:32.762187 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a815b422-ee92-4115-b46f-b5c34776cac7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:32.771560 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a815b422-ee92-4115-b46f-b5c34776cac7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:32.772209 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a815b422-ee92-4115-b46f-b5c34776cac7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:32.772716 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a815b422-ee92-4115-b46f-b5c34776cac7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:32.773500 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a815b422-ee92-4115-b46f-b5c34776cac7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:32.773979 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a815b422-ee92-4115-b46f-b5c34776cac7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:32.774668 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a815b422-ee92-4115-b46f-b5c34776cac7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:32.819077 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a815b422-ee92-4115-b46f-b5c34776cac7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066799 Sep 11 01:00:32.820699 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 309/614] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:00:32 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:33.030007 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e87a94aa-f79b-4411-9c92-21cde9397025 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:33.030643 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e87a94aa-f79b-4411-9c92-21cde9397025 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:33.037716 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e87a94aa-f79b-4411-9c92-21cde9397025 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:33.038198 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e87a94aa-f79b-4411-9c92-21cde9397025 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:33.038626 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e87a94aa-f79b-4411-9c92-21cde9397025 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:33.039354 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e87a94aa-f79b-4411-9c92-21cde9397025 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:33.040163 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e87a94aa-f79b-4411-9c92-21cde9397025 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:33.040580 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e87a94aa-f79b-4411-9c92-21cde9397025 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:33.105448 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e87a94aa-f79b-4411-9c92-21cde9397025 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:33.113954 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e87a94aa-f79b-4411-9c92-21cde9397025 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1293 microversion: 2.1 time: 0.088812 Sep 11 01:00:33.114533 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 306/615] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:33 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:33.574122 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-e99c97b2-3f6e-40ee-9a30-7d2b539f4d51 req-4191efdf-3a5d-4b67-abfe-a9f86d0e683e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb3eb557-558f-456d-83b2-23769926f3ca", "name": "network-vif-plugged", "status": "completed", "tag": "e9163d63-c63f-4164-9500-b11dcb2c600e"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:33.585788 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-e99c97b2-3f6e-40ee-9a30-7d2b539f4d51 req-4191efdf-3a5d-4b67-abfe-a9f86d0e683e service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:33.586299 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-e99c97b2-3f6e-40ee-9a30-7d2b539f4d51 req-4191efdf-3a5d-4b67-abfe-a9f86d0e683e service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:33.586709 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-e99c97b2-3f6e-40ee-9a30-7d2b539f4d51 req-4191efdf-3a5d-4b67-abfe-a9f86d0e683e service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:33.599070 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-e99c97b2-3f6e-40ee-9a30-7d2b539f4d51 req-4191efdf-3a5d-4b67-abfe-a9f86d0e683e service nova] Creating event network-vif-plugged:e9163d63-c63f-4164-9500-b11dcb2c600e for instance bb3eb557-558f-456d-83b2-23769926f3ca on hv-cinder-maste Sep 11 01:00:33.604230 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-e99c97b2-3f6e-40ee-9a30-7d2b539f4d51 req-4191efdf-3a5d-4b67-abfe-a9f86d0e683e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035172 Sep 11 01:00:33.604852 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 310/616] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:33.623639 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ce008807-af29-443f-ab39-bb2671b1249c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:33.624749 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ce008807-af29-443f-ab39-bb2671b1249c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:33.631016 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce008807-af29-443f-ab39-bb2671b1249c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:33.631827 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce008807-af29-443f-ab39-bb2671b1249c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:33.632601 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce008807-af29-443f-ab39-bb2671b1249c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:33.633307 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce008807-af29-443f-ab39-bb2671b1249c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:33.633978 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce008807-af29-443f-ab39-bb2671b1249c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:33.634606 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce008807-af29-443f-ab39-bb2671b1249c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:33.833184 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c2293f71-2b26-4246-a1c1-a17535a86e8a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:33.838240 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c2293f71-2b26-4246-a1c1-a17535a86e8a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:33.854111 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2293f71-2b26-4246-a1c1-a17535a86e8a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:33.854900 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2293f71-2b26-4246-a1c1-a17535a86e8a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:33.855602 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2293f71-2b26-4246-a1c1-a17535a86e8a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:33.856565 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2293f71-2b26-4246-a1c1-a17535a86e8a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:33.857225 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2293f71-2b26-4246-a1c1-a17535a86e8a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:33.858061 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2293f71-2b26-4246-a1c1-a17535a86e8a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:33.859510 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-ce008807-af29-443f-ab39-bb2671b1249c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:33.876676 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ce008807-af29-443f-ab39-bb2671b1249c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1363 microversion: 2.1 time: 0.255615 Sep 11 01:00:33.879331 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 307/617] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:33 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:33.907963 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c2293f71-2b26-4246-a1c1-a17535a86e8a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079069 Sep 11 01:00:33.908532 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 311/618] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:00:33 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:00:34.137624 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-14c82356-759c-4c4d-890d-9e3561c224c7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:34.138347 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-14c82356-759c-4c4d-890d-9e3561c224c7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:34.147343 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-14c82356-759c-4c4d-890d-9e3561c224c7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:34.148188 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-14c82356-759c-4c4d-890d-9e3561c224c7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:34.148818 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-14c82356-759c-4c4d-890d-9e3561c224c7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:34.149516 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-14c82356-759c-4c4d-890d-9e3561c224c7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:34.149961 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-14c82356-759c-4c4d-890d-9e3561c224c7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:34.150370 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-14c82356-759c-4c4d-890d-9e3561c224c7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:34.227854 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-14c82356-759c-4c4d-890d-9e3561c224c7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:34.236757 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-14c82356-759c-4c4d-890d-9e3561c224c7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1299 microversion: 2.1 time: 0.103304 Sep 11 01:00:34.237746 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 308/619] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:34 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:34.902009 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-af5c5ec3-e0cd-4c48-8357-82b142451f7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:34.902527 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-af5c5ec3-e0cd-4c48-8357-82b142451f7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:34.909579 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af5c5ec3-e0cd-4c48-8357-82b142451f7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:34.910064 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af5c5ec3-e0cd-4c48-8357-82b142451f7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:34.910499 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af5c5ec3-e0cd-4c48-8357-82b142451f7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:34.911221 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af5c5ec3-e0cd-4c48-8357-82b142451f7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:34.911665 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af5c5ec3-e0cd-4c48-8357-82b142451f7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:34.912147 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-af5c5ec3-e0cd-4c48-8357-82b142451f7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:34.926503 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-19502c14-9981-4ad4-9ec8-66b9155c5110 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:34.928859 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-19502c14-9981-4ad4-9ec8-66b9155c5110 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:34.941553 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-19502c14-9981-4ad4-9ec8-66b9155c5110 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:34.945047 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-19502c14-9981-4ad4-9ec8-66b9155c5110 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:34.945508 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-19502c14-9981-4ad4-9ec8-66b9155c5110 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:34.946228 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-19502c14-9981-4ad4-9ec8-66b9155c5110 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:34.946671 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-19502c14-9981-4ad4-9ec8-66b9155c5110 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:34.947099 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-19502c14-9981-4ad4-9ec8-66b9155c5110 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:34.951430 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:34.981601 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-19502c14-9981-4ad4-9ec8-66b9155c5110 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063145 Sep 11 01:00:34.982312 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 309/620] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:00:34 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 01:00:35.068896 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-555a7a90-3751-4d34-bed1-3ade9d175629 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:35.069389 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-555a7a90-3751-4d34-bed1-3ade9d175629 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:35.076199 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-555a7a90-3751-4d34-bed1-3ade9d175629 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:35.076681 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-555a7a90-3751-4d34-bed1-3ade9d175629 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:35.077109 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-555a7a90-3751-4d34-bed1-3ade9d175629 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:35.077802 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-555a7a90-3751-4d34-bed1-3ade9d175629 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:35.078398 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-555a7a90-3751-4d34-bed1-3ade9d175629 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:35.078831 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-555a7a90-3751-4d34-bed1-3ade9d175629 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:35.108304 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-555a7a90-3751-4d34-bed1-3ade9d175629 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 01:00:35.172949 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-af5c5ec3-e0cd-4c48-8357-82b142451f7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:35.181583 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-af5c5ec3-e0cd-4c48-8357-82b142451f7e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1363 microversion: 2.1 time: 0.283499 Sep 11 01:00:35.182775 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 312/621] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:34 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:35.213981 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-555a7a90-3751-4d34-bed1-3ade9d175629 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "DELETE /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 204 len: 0 microversion: 2.1 time: 0.149028 Sep 11 01:00:35.215407 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 310/622] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:00:35 2022] DELETE /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 01:00:35.223302 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-601120ff-ed3d-490f-94f4-93e8c310aed1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:35.223908 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-601120ff-ed3d-490f-94f4-93e8c310aed1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:35.230097 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-601120ff-ed3d-490f-94f4-93e8c310aed1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:35.230578 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-601120ff-ed3d-490f-94f4-93e8c310aed1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:35.231002 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-601120ff-ed3d-490f-94f4-93e8c310aed1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:35.231755 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-601120ff-ed3d-490f-94f4-93e8c310aed1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:35.232203 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-601120ff-ed3d-490f-94f4-93e8c310aed1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:35.232643 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-601120ff-ed3d-490f-94f4-93e8c310aed1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:35.262076 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4c55be84-65ad-409b-bd84-d7262027ac8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:35.264149 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4c55be84-65ad-409b-bd84-d7262027ac8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:35.271288 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c55be84-65ad-409b-bd84-d7262027ac8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:35.271811 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c55be84-65ad-409b-bd84-d7262027ac8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:35.272247 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c55be84-65ad-409b-bd84-d7262027ac8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:35.273173 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c55be84-65ad-409b-bd84-d7262027ac8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:35.273628 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c55be84-65ad-409b-bd84-d7262027ac8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:35.274052 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c55be84-65ad-409b-bd84-d7262027ac8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:35.478638 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-601120ff-ed3d-490f-94f4-93e8c310aed1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:35.487207 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-601120ff-ed3d-490f-94f4-93e8c310aed1 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1690 microversion: 2.1 time: 0.267838 Sep 11 01:00:35.488100 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 313/623] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:35 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1690 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:35.625195 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4c55be84-65ad-409b-bd84-d7262027ac8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:35.633395 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4c55be84-65ad-409b-bd84-d7262027ac8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1366 microversion: 2.1 time: 0.375639 Sep 11 01:00:35.633971 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 311/624] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:35 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:00:35.863920 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-46fb211f-d5dc-437a-9605-83687bf7a606 req-de1c8e43-a0d8-4de1-b329-041c6b2cf8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bf3c5f1-9b78-4721-97e4-170c26cbf0ff", "tag": "c9d534bc-7ccd-4776-bdcc-c40c6c04e9fa"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:35.875567 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-46fb211f-d5dc-437a-9605-83687bf7a606 req-de1c8e43-a0d8-4de1-b329-041c6b2cf8b0 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:35.876926 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-46fb211f-d5dc-437a-9605-83687bf7a606 req-de1c8e43-a0d8-4de1-b329-041c6b2cf8b0 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:35.877344 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-46fb211f-d5dc-437a-9605-83687bf7a606 req-de1c8e43-a0d8-4de1-b329-041c6b2cf8b0 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:35.890720 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-46fb211f-d5dc-437a-9605-83687bf7a606 req-de1c8e43-a0d8-4de1-b329-041c6b2cf8b0 service nova] Creating event network-changed:c9d534bc-7ccd-4776-bdcc-c40c6c04e9fa for instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff on hv-cinder-maste Sep 11 01:00:35.895839 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-46fb211f-d5dc-437a-9605-83687bf7a606 req-de1c8e43-a0d8-4de1-b329-041c6b2cf8b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037508 Sep 11 01:00:35.896371 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 314/625] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:36.207299 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2378c5e2-375b-4606-9930-c4370dff0212 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:36.207899 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2378c5e2-375b-4606-9930-c4370dff0212 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:36.215067 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2378c5e2-375b-4606-9930-c4370dff0212 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:36.216543 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2378c5e2-375b-4606-9930-c4370dff0212 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:36.216543 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2378c5e2-375b-4606-9930-c4370dff0212 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:36.216700 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2378c5e2-375b-4606-9930-c4370dff0212 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:36.217075 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2378c5e2-375b-4606-9930-c4370dff0212 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:36.217617 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2378c5e2-375b-4606-9930-c4370dff0212 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:36.364892 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-2378c5e2-375b-4606-9930-c4370dff0212 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:36.373694 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2378c5e2-375b-4606-9930-c4370dff0212 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1549 microversion: 2.1 time: 0.170338 Sep 11 01:00:36.374282 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 312/626] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:36 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:36.396716 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6e65f332-bc18-4e6a-a988-f8cbb6c7d737 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:36.397326 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6e65f332-bc18-4e6a-a988-f8cbb6c7d737 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:36.399813 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:36.405490 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6e65f332-bc18-4e6a-a988-f8cbb6c7d737 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:36.405978 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6e65f332-bc18-4e6a-a988-f8cbb6c7d737 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:36.406412 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6e65f332-bc18-4e6a-a988-f8cbb6c7d737 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:36.407110 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6e65f332-bc18-4e6a-a988-f8cbb6c7d737 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:36.407584 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6e65f332-bc18-4e6a-a988-f8cbb6c7d737 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:36.408001 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6e65f332-bc18-4e6a-a988-f8cbb6c7d737 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:36.509102 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6e65f332-bc18-4e6a-a988-f8cbb6c7d737 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116289 Sep 11 01:00:36.509711 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 315/627] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Sep 11 01:00:36 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:36.515711 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4e761805-2a1b-4d69-99c5-163ba2c12253 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:36.516331 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4e761805-2a1b-4d69-99c5-163ba2c12253 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:36.522712 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4e761805-2a1b-4d69-99c5-163ba2c12253 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:36.523211 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4e761805-2a1b-4d69-99c5-163ba2c12253 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:36.523706 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4e761805-2a1b-4d69-99c5-163ba2c12253 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:36.524343 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4e761805-2a1b-4d69-99c5-163ba2c12253 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:36.524786 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4e761805-2a1b-4d69-99c5-163ba2c12253 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:36.525202 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4e761805-2a1b-4d69-99c5-163ba2c12253 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:36.656920 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-2a21a923-9bf6-497c-ace1-7a56b7428b4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:36.658106 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-2a21a923-9bf6-497c-ace1-7a56b7428b4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:36.665661 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2a21a923-9bf6-497c-ace1-7a56b7428b4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:36.666447 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2a21a923-9bf6-497c-ace1-7a56b7428b4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:36.667092 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2a21a923-9bf6-497c-ace1-7a56b7428b4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:36.668022 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2a21a923-9bf6-497c-ace1-7a56b7428b4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:36.668534 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2a21a923-9bf6-497c-ace1-7a56b7428b4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:36.669277 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2a21a923-9bf6-497c-ace1-7a56b7428b4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:36.871566 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4e761805-2a1b-4d69-99c5-163ba2c12253 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:36.879577 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4e761805-2a1b-4d69-99c5-163ba2c12253 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1690 microversion: 2.1 time: 0.372892 Sep 11 01:00:36.891274 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 313/628] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:36 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1690 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:36.937062 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-2a21a923-9bf6-497c-ace1-7a56b7428b4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:36.946306 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-2a21a923-9bf6-497c-ace1-7a56b7428b4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1366 microversion: 2.1 time: 0.293467 Sep 11 01:00:36.946898 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 316/629] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:36 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:00:37.904992 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-635296d8-98a3-4d93-a383-3d847cfe4b33 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:37.905968 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-635296d8-98a3-4d93-a383-3d847cfe4b33 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:37.910472 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-3f5b451e-2f81-4a2d-b9b9-3e0af5f92187 req-2bdf47e2-6293-4df4-b617-2c0462568687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb3eb557-558f-456d-83b2-23769926f3ca", "tag": "e9163d63-c63f-4164-9500-b11dcb2c600e"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:37.912464 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-635296d8-98a3-4d93-a383-3d847cfe4b33 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:37.912963 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-635296d8-98a3-4d93-a383-3d847cfe4b33 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:37.913397 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-635296d8-98a3-4d93-a383-3d847cfe4b33 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:37.914072 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-635296d8-98a3-4d93-a383-3d847cfe4b33 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:37.915112 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-635296d8-98a3-4d93-a383-3d847cfe4b33 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:37.915573 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-635296d8-98a3-4d93-a383-3d847cfe4b33 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:37.921403 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-3f5b451e-2f81-4a2d-b9b9-3e0af5f92187 req-2bdf47e2-6293-4df4-b617-2c0462568687 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:37.921861 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-3f5b451e-2f81-4a2d-b9b9-3e0af5f92187 req-2bdf47e2-6293-4df4-b617-2c0462568687 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:37.922262 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-3f5b451e-2f81-4a2d-b9b9-3e0af5f92187 req-2bdf47e2-6293-4df4-b617-2c0462568687 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:37.934981 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-3f5b451e-2f81-4a2d-b9b9-3e0af5f92187 req-2bdf47e2-6293-4df4-b617-2c0462568687 service nova] Creating event network-changed:e9163d63-c63f-4164-9500-b11dcb2c600e for instance bb3eb557-558f-456d-83b2-23769926f3ca on hv-cinder-maste Sep 11 01:00:37.940048 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-3f5b451e-2f81-4a2d-b9b9-3e0af5f92187 req-2bdf47e2-6293-4df4-b617-2c0462568687 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033240 Sep 11 01:00:37.940657 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 317/630] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:00:37.977351 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d917e166-fab1-40cf-a24c-926a8458e65b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:37.978346 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d917e166-fab1-40cf-a24c-926a8458e65b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:37.985462 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d917e166-fab1-40cf-a24c-926a8458e65b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:37.985956 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d917e166-fab1-40cf-a24c-926a8458e65b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:37.986384 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d917e166-fab1-40cf-a24c-926a8458e65b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:37.987115 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d917e166-fab1-40cf-a24c-926a8458e65b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:37.988271 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d917e166-fab1-40cf-a24c-926a8458e65b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:37.988712 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d917e166-fab1-40cf-a24c-926a8458e65b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:38.070081 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-635296d8-98a3-4d93-a383-3d847cfe4b33 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:38.078549 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-635296d8-98a3-4d93-a383-3d847cfe4b33 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1690 microversion: 2.1 time: 0.178195 Sep 11 01:00:38.079573 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 314/631] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:37 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:38.191277 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d917e166-fab1-40cf-a24c-926a8458e65b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:38.199523 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d917e166-fab1-40cf-a24c-926a8458e65b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1366 microversion: 2.1 time: 0.227363 Sep 11 01:00:38.200115 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 318/632] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:37 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:00:39.104810 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c4f4a8fc-97b2-4f67-948e-b2fa3a9d14c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:39.105489 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c4f4a8fc-97b2-4f67-948e-b2fa3a9d14c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:39.112305 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c4f4a8fc-97b2-4f67-948e-b2fa3a9d14c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:39.112712 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c4f4a8fc-97b2-4f67-948e-b2fa3a9d14c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:39.113138 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c4f4a8fc-97b2-4f67-948e-b2fa3a9d14c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:39.113858 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c4f4a8fc-97b2-4f67-948e-b2fa3a9d14c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:39.114304 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c4f4a8fc-97b2-4f67-948e-b2fa3a9d14c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:39.114711 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c4f4a8fc-97b2-4f67-948e-b2fa3a9d14c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:39.222081 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-4bb85ec0-6799-4bba-a868-96670b8842ef tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:39.222743 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-4bb85ec0-6799-4bba-a868-96670b8842ef tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:39.229795 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4bb85ec0-6799-4bba-a868-96670b8842ef tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:39.230378 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4bb85ec0-6799-4bba-a868-96670b8842ef tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:39.230878 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4bb85ec0-6799-4bba-a868-96670b8842ef tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:39.231692 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4bb85ec0-6799-4bba-a868-96670b8842ef tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:39.232208 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4bb85ec0-6799-4bba-a868-96670b8842ef tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:39.232864 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4bb85ec0-6799-4bba-a868-96670b8842ef tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:39.400141 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c4f4a8fc-97b2-4f67-948e-b2fa3a9d14c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:39.414623 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c4f4a8fc-97b2-4f67-948e-b2fa3a9d14c6 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1690 microversion: 2.1 time: 0.313468 Sep 11 01:00:39.415487 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 315/633] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:39 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1690 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:00:39.429867 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-4bb85ec0-6799-4bba-a868-96670b8842ef tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:39.438150 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-4bb85ec0-6799-4bba-a868-96670b8842ef tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1366 microversion: 2.1 time: 0.220059 Sep 11 01:00:39.438817 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 319/634] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:39 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:40.438347 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5a05a9eb-44b2-4421-bbea-08ea1fe20a95 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:40.438947 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5a05a9eb-44b2-4421-bbea-08ea1fe20a95 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:40.446433 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a05a9eb-44b2-4421-bbea-08ea1fe20a95 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:40.446933 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a05a9eb-44b2-4421-bbea-08ea1fe20a95 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:40.449148 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a05a9eb-44b2-4421-bbea-08ea1fe20a95 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:40.450975 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a05a9eb-44b2-4421-bbea-08ea1fe20a95 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:40.454856 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a05a9eb-44b2-4421-bbea-08ea1fe20a95 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:40.455800 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5a05a9eb-44b2-4421-bbea-08ea1fe20a95 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:40.462492 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e1421761-22be-44e5-8546-0a798199bd0a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:40.463869 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-e1421761-22be-44e5-8546-0a798199bd0a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:40.471355 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e1421761-22be-44e5-8546-0a798199bd0a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:40.472734 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e1421761-22be-44e5-8546-0a798199bd0a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:40.473409 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e1421761-22be-44e5-8546-0a798199bd0a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:40.474371 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e1421761-22be-44e5-8546-0a798199bd0a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:40.475035 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e1421761-22be-44e5-8546-0a798199bd0a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:40.476019 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e1421761-22be-44e5-8546-0a798199bd0a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:40.615148 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-5a05a9eb-44b2-4421-bbea-08ea1fe20a95 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:40.624720 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5a05a9eb-44b2-4421-bbea-08ea1fe20a95 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1622 microversion: 2.1 time: 0.190467 Sep 11 01:00:40.625572 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 316/635] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:40 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1622 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:00:40.785465 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-e1421761-22be-44e5-8546-0a798199bd0a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:40.796507 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-e1421761-22be-44e5-8546-0a798199bd0a tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1366 microversion: 2.1 time: 0.338335 Sep 11 01:00:40.797627 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 320/636] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:40 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:40.976378 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-5e485fd7-f198-4296-aa68-eeaa01b5be62 req-3826f35a-69f1-4d09-9a70-f58dda20358f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56cf74eb-5098-47e8-b99c-efd0af892b66", "name": "network-vif-deleted", "tag": "5ae85da6-bc81-47ad-9baf-b2583a2b801b"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:40.994665 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:41.014040 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-5e485fd7-f198-4296-aa68-eeaa01b5be62 req-3826f35a-69f1-4d09-9a70-f58dda20358f service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:41.014536 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-5e485fd7-f198-4296-aa68-eeaa01b5be62 req-3826f35a-69f1-4d09-9a70-f58dda20358f service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:41.014968 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-5e485fd7-f198-4296-aa68-eeaa01b5be62 req-3826f35a-69f1-4d09-9a70-f58dda20358f service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:41.038740 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-5e485fd7-f198-4296-aa68-eeaa01b5be62 req-3826f35a-69f1-4d09-9a70-f58dda20358f service nova] Creating event network-vif-deleted:5ae85da6-bc81-47ad-9baf-b2583a2b801b for instance 56cf74eb-5098-47e8-b99c-efd0af892b66 on hv-cinder-maste Sep 11 01:00:41.045576 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-5e485fd7-f198-4296-aa68-eeaa01b5be62 req-3826f35a-69f1-4d09-9a70-f58dda20358f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073818 Sep 11 01:00:41.047038 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 317/637] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:41.649428 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-acda1295-41b2-4c5a-83e3-2022e29ebb99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:41.650804 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-acda1295-41b2-4c5a-83e3-2022e29ebb99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:41.658709 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-acda1295-41b2-4c5a-83e3-2022e29ebb99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:41.659493 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-acda1295-41b2-4c5a-83e3-2022e29ebb99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:41.660183 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-acda1295-41b2-4c5a-83e3-2022e29ebb99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:41.661130 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-acda1295-41b2-4c5a-83e3-2022e29ebb99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:41.661821 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-acda1295-41b2-4c5a-83e3-2022e29ebb99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:41.662470 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-acda1295-41b2-4c5a-83e3-2022e29ebb99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:41.702766 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-acda1295-41b2-4c5a-83e3-2022e29ebb99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:41.703533 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-acda1295-41b2-4c5a-83e3-2022e29ebb99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:41.704057 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-acda1295-41b2-4c5a-83e3-2022e29ebb99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:41.704695 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-acda1295-41b2-4c5a-83e3-2022e29ebb99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lazy-loading 'fault' on Instance uuid 56cf74eb-5098-47e8-b99c-efd0af892b66 {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:00:41.763341 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-acda1295-41b2-4c5a-83e3-2022e29ebb99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:41.777258 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-acda1295-41b2-4c5a-83e3-2022e29ebb99 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1336 microversion: 2.1 time: 0.132200 Sep 11 01:00:41.778972 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 321/638] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:41 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1336 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:41.825413 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-44e7c516-5b5a-4bca-9353-cf65ae0cba29 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:41.826779 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-44e7c516-5b5a-4bca-9353-cf65ae0cba29 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:41.835448 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44e7c516-5b5a-4bca-9353-cf65ae0cba29 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:41.836282 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44e7c516-5b5a-4bca-9353-cf65ae0cba29 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:41.836885 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44e7c516-5b5a-4bca-9353-cf65ae0cba29 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:41.838114 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44e7c516-5b5a-4bca-9353-cf65ae0cba29 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:41.838802 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44e7c516-5b5a-4bca-9353-cf65ae0cba29 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:41.839572 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44e7c516-5b5a-4bca-9353-cf65ae0cba29 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:42.004350 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=8 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:42.049107 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-44e7c516-5b5a-4bca-9353-cf65ae0cba29 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:42.061345 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-44e7c516-5b5a-4bca-9353-cf65ae0cba29 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1366 microversion: 2.1 time: 0.244965 Sep 11 01:00:42.061944 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 318/639] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:41 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:42.803356 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b012792e-63af-4816-92ce-c73a38df3573 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:42.808136 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-b012792e-63af-4816-92ce-c73a38df3573 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:42.814401 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=4 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:42.816419 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=16 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:42.821568 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b012792e-63af-4816-92ce-c73a38df3573 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:42.822045 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b012792e-63af-4816-92ce-c73a38df3573 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:42.822480 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b012792e-63af-4816-92ce-c73a38df3573 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:42.823235 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b012792e-63af-4816-92ce-c73a38df3573 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:42.823711 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b012792e-63af-4816-92ce-c73a38df3573 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:42.824129 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b012792e-63af-4816-92ce-c73a38df3573 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:42.860656 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=100 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:42.887006 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b012792e-63af-4816-92ce-c73a38df3573 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:42.887524 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b012792e-63af-4816-92ce-c73a38df3573 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:42.887957 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b012792e-63af-4816-92ce-c73a38df3573 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:42.888577 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-b012792e-63af-4816-92ce-c73a38df3573 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lazy-loading 'fault' on Instance uuid 56cf74eb-5098-47e8-b99c-efd0af892b66 {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:00:42.944649 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-b012792e-63af-4816-92ce-c73a38df3573 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:42.955540 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-b012792e-63af-4816-92ce-c73a38df3573 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 200 len: 1336 microversion: 2.1 time: 0.156711 Sep 11 01:00:42.956436 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 322/640] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:42 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 1336 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:43.097382 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-84e21f52-05bc-4b1d-95cd-c987987fd78e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:43.098009 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-84e21f52-05bc-4b1d-95cd-c987987fd78e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:43.104809 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-84e21f52-05bc-4b1d-95cd-c987987fd78e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:43.105590 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-84e21f52-05bc-4b1d-95cd-c987987fd78e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:43.106020 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-84e21f52-05bc-4b1d-95cd-c987987fd78e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:43.106751 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-84e21f52-05bc-4b1d-95cd-c987987fd78e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:43.107259 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-84e21f52-05bc-4b1d-95cd-c987987fd78e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:43.107726 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-84e21f52-05bc-4b1d-95cd-c987987fd78e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:43.257613 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-84e21f52-05bc-4b1d-95cd-c987987fd78e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:43.270393 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-84e21f52-05bc-4b1d-95cd-c987987fd78e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1366 microversion: 2.1 time: 0.177336 Sep 11 01:00:43.271328 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 319/641] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:43 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:43.982211 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8b066ce2-6f9d-44ee-98bd-08d02202a887 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:43.983732 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-8b066ce2-6f9d-44ee-98bd-08d02202a887 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 56cf74eb-5098-47e8-b99c-efd0af892b66] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:43.998567 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8b066ce2-6f9d-44ee-98bd-08d02202a887 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:44.000723 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8b066ce2-6f9d-44ee-98bd-08d02202a887 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:44.003047 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8b066ce2-6f9d-44ee-98bd-08d02202a887 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:44.005133 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8b066ce2-6f9d-44ee-98bd-08d02202a887 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:44.005959 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8b066ce2-6f9d-44ee-98bd-08d02202a887 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:44.007519 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8b066ce2-6f9d-44ee-98bd-08d02202a887 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:44.046691 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-8b066ce2-6f9d-44ee-98bd-08d02202a887 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] HTTP exception thrown: Instance 56cf74eb-5098-47e8-b99c-efd0af892b66 could not be found. Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8b066ce2-6f9d-44ee-98bd-08d02202a887 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Request method failure captured: Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 HTTP/1.1 Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTIZV3OGXS0Y0dMCJR3JsNV5yeizCzXf9d_TuViBBFaAqgn8TDP7z7jkssGhxEzL2Hkj8d0DyUdQPhy8rCBCc-PskzFupuPpZKa-RVGVZcBl67AuQkQbqQObAzrPZ5DBpyPNMKv8zeY6EtLRNUIutKSaCaDQe1MRr7gfF_WIm51FEcc Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: ac8c0850e1ac43e7913a88dbb7b7e9f8 Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:00:44.050491 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:00:44.052248 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8c0850e1ac43e7913a88dbb7b7e9f8", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:00:44.052248 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 01:00:44.052248 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: ac8c0850e1ac43e7913a88dbb7b7e9f8 Sep 11 01:00:44.052248 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 01:00:44.052248 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-ServerRescueNegativeTestJSON-2141619617-project Sep 11 01:00:44.052248 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:00:44.052248 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:00:44.052248 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 03a3c989ecef42e084fb44d47c55b27e Sep 11 01:00:44.052248 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2141619617-project Sep 11 01:00:44.052248 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 01:00:44.052248 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance 56cf74eb-5098-47e8-b99c-efd0af892b66 could not be found. Sep 11 01:00:44.052248 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': '56cf74eb-5098-47e8-b99c-efd0af892b66'} Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56cf74eb-5098-47e8-b99c-efd0af892b66 could not be found. Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:00:44.053055 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56cf74eb-5098-47e8-b99c-efd0af892b66 could not be found. Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56cf74eb-5098-47e8-b99c-efd0af892b66 could not be found. Sep 11 01:00:44.055196 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:00:44.059960 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8b066ce2-6f9d-44ee-98bd-08d02202a887 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Returning 404 to user: Instance 56cf74eb-5098-47e8-b99c-efd0af892b66 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:00:44.061685 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8b066ce2-6f9d-44ee-98bd-08d02202a887 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66" status: 404 len: 111 microversion: 2.1 time: 0.085180 Sep 11 01:00:44.065133 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 323/642] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:43 2022] GET /compute/v2.1/servers/56cf74eb-5098-47e8-b99c-efd0af892b66 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:00:44.072995 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-80f62d8f-dbb7-4725-93ae-315e932a9a64 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '.version_select at 0x7fbb90696dc0>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:44.121640 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-80f62d8f-dbb7-4725-93ae-315e932a9a64 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1369128276" status: 202 len: 0 microversion: 2.1 time: 0.052039 Sep 11 01:00:44.126418 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 320/643] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Sep 11 01:00:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1369128276 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:00:44.300700 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-4221d709-11d8-4f76-b683-277367323104 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:44.303825 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-4221d709-11d8-4f76-b683-277367323104 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:44.333843 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4221d709-11d8-4f76-b683-277367323104 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:44.335763 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4221d709-11d8-4f76-b683-277367323104 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:44.336899 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4221d709-11d8-4f76-b683-277367323104 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:44.342692 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4221d709-11d8-4f76-b683-277367323104 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:44.348139 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4221d709-11d8-4f76-b683-277367323104 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:44.349178 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-4221d709-11d8-4f76-b683-277367323104 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:45.138103 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-4221d709-11d8-4f76-b683-277367323104 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:45.162624 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-4221d709-11d8-4f76-b683-277367323104 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1366 microversion: 2.1 time: 0.869638 Sep 11 01:00:45.164015 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 324/644] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:44 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1366 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:45.666133 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-06bbf228-b117-4f46-bb8e-47ed8acc70e7 req-06e463c4-96c3-4631-bd16-afa9405c17c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf3c5f1-9b78-4721-97e4-170c26cbf0ff", "name": "network-vif-plugged", "status": "completed", "tag": "c9d534bc-7ccd-4776-bdcc-c40c6c04e9fa"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:45.679108 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-06bbf228-b117-4f46-bb8e-47ed8acc70e7 req-06e463c4-96c3-4631-bd16-afa9405c17c3 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:45.680167 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-06bbf228-b117-4f46-bb8e-47ed8acc70e7 req-06e463c4-96c3-4631-bd16-afa9405c17c3 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:45.680773 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-06bbf228-b117-4f46-bb8e-47ed8acc70e7 req-06e463c4-96c3-4631-bd16-afa9405c17c3 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:45.700638 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-06bbf228-b117-4f46-bb8e-47ed8acc70e7 req-06e463c4-96c3-4631-bd16-afa9405c17c3 service nova] Creating event network-vif-plugged:c9d534bc-7ccd-4776-bdcc-c40c6c04e9fa for instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff on hv-cinder-maste Sep 11 01:00:45.712523 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-06bbf228-b117-4f46-bb8e-47ed8acc70e7 req-06e463c4-96c3-4631-bd16-afa9405c17c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051437 Sep 11 01:00:45.713751 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 321/645] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:46.185721 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-134e6059-1265-4f10-a54f-a88f1860dfab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:46.186438 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-134e6059-1265-4f10-a54f-a88f1860dfab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:46.193430 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-134e6059-1265-4f10-a54f-a88f1860dfab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:46.193924 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-134e6059-1265-4f10-a54f-a88f1860dfab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:46.194337 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-134e6059-1265-4f10-a54f-a88f1860dfab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:46.195038 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-134e6059-1265-4f10-a54f-a88f1860dfab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:46.195520 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-134e6059-1265-4f10-a54f-a88f1860dfab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:46.195948 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-134e6059-1265-4f10-a54f-a88f1860dfab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:46.339467 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-134e6059-1265-4f10-a54f-a88f1860dfab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:46.347886 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-134e6059-1265-4f10-a54f-a88f1860dfab tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1366 microversion: 2.1 time: 0.165824 Sep 11 01:00:46.348441 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 325/646] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:46 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:47.372960 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b076f07e-c008-40a7-be80-7209224b582b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:47.374190 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b076f07e-c008-40a7-be80-7209224b582b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:47.384524 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b076f07e-c008-40a7-be80-7209224b582b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:47.385312 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b076f07e-c008-40a7-be80-7209224b582b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:47.386340 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b076f07e-c008-40a7-be80-7209224b582b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:47.388697 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b076f07e-c008-40a7-be80-7209224b582b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:47.389451 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b076f07e-c008-40a7-be80-7209224b582b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:47.390386 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b076f07e-c008-40a7-be80-7209224b582b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:47.580011 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-7161178c-5a65-409f-b5e1-abf3cab0878d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:47.581447 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-7161178c-5a65-409f-b5e1-abf3cab0878d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:47.588381 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7161178c-5a65-409f-b5e1-abf3cab0878d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:47.588867 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7161178c-5a65-409f-b5e1-abf3cab0878d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:47.589305 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7161178c-5a65-409f-b5e1-abf3cab0878d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:47.590231 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7161178c-5a65-409f-b5e1-abf3cab0878d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:47.590676 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7161178c-5a65-409f-b5e1-abf3cab0878d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:47.591312 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7161178c-5a65-409f-b5e1-abf3cab0878d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:47.618316 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-7161178c-5a65-409f-b5e1-abf3cab0878d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Going to try to terminate instance {{(pid=120497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 01:00:47.735280 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b076f07e-c008-40a7-be80-7209224b582b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:47.744796 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b076f07e-c008-40a7-be80-7209224b582b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1557 microversion: 2.1 time: 0.377724 Sep 11 01:00:47.747799 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-7161178c-5a65-409f-b5e1-abf3cab0878d tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "DELETE /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 204 len: 0 microversion: 2.1 time: 0.172252 Sep 11 01:00:47.748650 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 322/647] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:47 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1557 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:00:47.749344 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 326/648] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:00:47 2022] DELETE /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 01:00:47.772263 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-dc1968b4-8576-42e7-81cc-cb3fcac4d0da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:47.773186 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-dc1968b4-8576-42e7-81cc-cb3fcac4d0da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:47.782187 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a01a0727-2568-4b15-9ae7-01c1fd22d163 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:47.794763 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc1968b4-8576-42e7-81cc-cb3fcac4d0da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:47.808515 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc1968b4-8576-42e7-81cc-cb3fcac4d0da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:47.809772 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a01a0727-2568-4b15-9ae7-01c1fd22d163 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:47.813451 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc1968b4-8576-42e7-81cc-cb3fcac4d0da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:47.814483 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc1968b4-8576-42e7-81cc-cb3fcac4d0da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:47.815104 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc1968b4-8576-42e7-81cc-cb3fcac4d0da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:47.815729 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc1968b4-8576-42e7-81cc-cb3fcac4d0da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:47.823902 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a01a0727-2568-4b15-9ae7-01c1fd22d163 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:47.827146 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a01a0727-2568-4b15-9ae7-01c1fd22d163 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:47.827622 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a01a0727-2568-4b15-9ae7-01c1fd22d163 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:47.828380 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a01a0727-2568-4b15-9ae7-01c1fd22d163 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:47.828835 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a01a0727-2568-4b15-9ae7-01c1fd22d163 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:47.829254 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a01a0727-2568-4b15-9ae7-01c1fd22d163 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:48.017761 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a01a0727-2568-4b15-9ae7-01c1fd22d163 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.239989 Sep 11 01:00:48.018876 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 327/649] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Sep 11 01:00:47 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/os-interface => generated 285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:48.164656 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-dc1968b4-8576-42e7-81cc-cb3fcac4d0da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:48.174117 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-dc1968b4-8576-42e7-81cc-cb3fcac4d0da tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1507 microversion: 2.1 time: 0.405885 Sep 11 01:00:48.188328 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 323/650] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:47 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:49.201870 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-9fd5c718-6e2d-4ed1-8cb0-57feebf85d7a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:49.203118 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-9fd5c718-6e2d-4ed1-8cb0-57feebf85d7a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:49.210737 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9fd5c718-6e2d-4ed1-8cb0-57feebf85d7a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:49.213149 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9fd5c718-6e2d-4ed1-8cb0-57feebf85d7a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:49.213699 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9fd5c718-6e2d-4ed1-8cb0-57feebf85d7a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:49.214516 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9fd5c718-6e2d-4ed1-8cb0-57feebf85d7a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:49.215778 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9fd5c718-6e2d-4ed1-8cb0-57feebf85d7a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:49.216375 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9fd5c718-6e2d-4ed1-8cb0-57feebf85d7a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:49.487960 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-9fd5c718-6e2d-4ed1-8cb0-57feebf85d7a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:49.497022 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-9fd5c718-6e2d-4ed1-8cb0-57feebf85d7a tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1507 microversion: 2.1 time: 0.301835 Sep 11 01:00:49.507763 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 328/651] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:49 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:49.803519 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-48a241bd-04c2-4b8e-91bf-0b4f8d098428 req-252892d6-e217-4ea8-a6ee-a17703c968a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bf3c5f1-9b78-4721-97e4-170c26cbf0ff", "tag": "c9d534bc-7ccd-4776-bdcc-c40c6c04e9fa"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:49.821003 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-48a241bd-04c2-4b8e-91bf-0b4f8d098428 req-252892d6-e217-4ea8-a6ee-a17703c968a2 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:49.821648 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-48a241bd-04c2-4b8e-91bf-0b4f8d098428 req-252892d6-e217-4ea8-a6ee-a17703c968a2 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:49.822190 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-48a241bd-04c2-4b8e-91bf-0b4f8d098428 req-252892d6-e217-4ea8-a6ee-a17703c968a2 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:49.857180 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-48a241bd-04c2-4b8e-91bf-0b4f8d098428 req-252892d6-e217-4ea8-a6ee-a17703c968a2 service nova] Creating event network-changed:c9d534bc-7ccd-4776-bdcc-c40c6c04e9fa for instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff on hv-cinder-maste Sep 11 01:00:49.869397 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-48a241bd-04c2-4b8e-91bf-0b4f8d098428 req-252892d6-e217-4ea8-a6ee-a17703c968a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072470 Sep 11 01:00:49.870238 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 324/652] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:50.522339 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-90de096e-c798-41a2-a687-c41e8713277e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:50.522970 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-90de096e-c798-41a2-a687-c41e8713277e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:50.537406 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-90de096e-c798-41a2-a687-c41e8713277e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:50.538351 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-90de096e-c798-41a2-a687-c41e8713277e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:50.540227 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-90de096e-c798-41a2-a687-c41e8713277e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:50.546686 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-90de096e-c798-41a2-a687-c41e8713277e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:50.551063 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-90de096e-c798-41a2-a687-c41e8713277e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:50.556311 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-90de096e-c798-41a2-a687-c41e8713277e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:51.207619 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-90de096e-c798-41a2-a687-c41e8713277e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:51.219955 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-90de096e-c798-41a2-a687-c41e8713277e tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1507 microversion: 2.1 time: 0.700618 Sep 11 01:00:51.220617 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 329/653] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:50 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1507 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:52.242967 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-348f0b48-aab2-4d80-a131-bfbeda53e8a0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:52.243828 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-348f0b48-aab2-4d80-a131-bfbeda53e8a0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:52.262500 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-348f0b48-aab2-4d80-a131-bfbeda53e8a0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:52.263281 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-348f0b48-aab2-4d80-a131-bfbeda53e8a0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:52.266448 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-348f0b48-aab2-4d80-a131-bfbeda53e8a0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:52.269272 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-348f0b48-aab2-4d80-a131-bfbeda53e8a0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:52.271869 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-348f0b48-aab2-4d80-a131-bfbeda53e8a0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:52.273232 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-348f0b48-aab2-4d80-a131-bfbeda53e8a0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:52.547490 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-134b1148-5b56-464c-bd6e-f1238869ab18 req-9820f29c-96a5-4cb5-97bc-d2a176e9ab8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67923a02-d1a5-4177-b7f3-15e4e795894a", "name": "network-vif-deleted", "tag": "56083e81-21bc-4e71-a9e4-4346256d398e"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:52.568942 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-134b1148-5b56-464c-bd6e-f1238869ab18 req-9820f29c-96a5-4cb5-97bc-d2a176e9ab8c service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:52.569667 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-134b1148-5b56-464c-bd6e-f1238869ab18 req-9820f29c-96a5-4cb5-97bc-d2a176e9ab8c service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:52.570270 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-134b1148-5b56-464c-bd6e-f1238869ab18 req-9820f29c-96a5-4cb5-97bc-d2a176e9ab8c service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:52.570777 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-348f0b48-aab2-4d80-a131-bfbeda53e8a0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:52.585698 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-348f0b48-aab2-4d80-a131-bfbeda53e8a0 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 200 len: 1465 microversion: 2.1 time: 0.346905 Sep 11 01:00:52.588770 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 325/654] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:52 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 1465 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:52.602033 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-134b1148-5b56-464c-bd6e-f1238869ab18 req-9820f29c-96a5-4cb5-97bc-d2a176e9ab8c service nova] Creating event network-vif-deleted:56083e81-21bc-4e71-a9e4-4346256d398e for instance 67923a02-d1a5-4177-b7f3-15e4e795894a on hv-cinder-maste Sep 11 01:00:52.611399 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-134b1148-5b56-464c-bd6e-f1238869ab18 req-9820f29c-96a5-4cb5-97bc-d2a176e9ab8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068415 Sep 11 01:00:52.616561 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 330/655] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:00:53.931122 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-232e6714-d50e-40d3-996d-6c909b39b7b8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:53.932674 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-232e6714-d50e-40d3-996d-6c909b39b7b8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: 67923a02-d1a5-4177-b7f3-15e4e795894a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:53.940879 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-232e6714-d50e-40d3-996d-6c909b39b7b8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:53.941821 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-232e6714-d50e-40d3-996d-6c909b39b7b8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:53.942429 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-232e6714-d50e-40d3-996d-6c909b39b7b8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:53.943323 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-232e6714-d50e-40d3-996d-6c909b39b7b8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:53.943940 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-232e6714-d50e-40d3-996d-6c909b39b7b8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:53.944520 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-232e6714-d50e-40d3-996d-6c909b39b7b8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:53.960252 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-232e6714-d50e-40d3-996d-6c909b39b7b8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] HTTP exception thrown: Instance 67923a02-d1a5-4177-b7f3-15e4e795894a could not be found. Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-232e6714-d50e-40d3-996d-6c909b39b7b8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Request method failure captured: Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a HTTP/1.1 Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIZV3OGXS0Y0dMCJR3JsNV5yeizCzXf9d_TuViBBFaAqgn8TDP7z7jkssGhxEzL2Hkj8d0DyUdQPhy8rCBCc-PskzFupuPpZKa-RVGVZcBl67AuQkQbqQObAzrPZ5DBpyPNMKv8zeY6EtLRNUIutKSaCaDQe1MRr7gfF_WIm51FEcc Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: ac8c0850e1ac43e7913a88dbb7b7e9f8 Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:00:53.962524 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:00:53.970800 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8c0850e1ac43e7913a88dbb7b7e9f8", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:00:53.970800 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 01:00:53.970800 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: ac8c0850e1ac43e7913a88dbb7b7e9f8 Sep 11 01:00:53.970800 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 01:00:53.970800 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-ServerRescueNegativeTestJSON-2141619617-project Sep 11 01:00:53.970800 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:00:53.970800 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:00:53.970800 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 03a3c989ecef42e084fb44d47c55b27e Sep 11 01:00:53.970800 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2141619617-project Sep 11 01:00:53.970800 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:00:53.970800 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance 67923a02-d1a5-4177-b7f3-15e4e795894a could not be found. Sep 11 01:00:53.970800 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': '67923a02-d1a5-4177-b7f3-15e4e795894a'} Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67923a02-d1a5-4177-b7f3-15e4e795894a could not be found. Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:00:53.972446 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67923a02-d1a5-4177-b7f3-15e4e795894a could not be found. Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67923a02-d1a5-4177-b7f3-15e4e795894a could not be found. Sep 11 01:00:53.974938 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:00:53.977318 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-232e6714-d50e-40d3-996d-6c909b39b7b8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Returning 404 to user: Instance 67923a02-d1a5-4177-b7f3-15e4e795894a could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:00:53.977318 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-232e6714-d50e-40d3-996d-6c909b39b7b8 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a" status: 404 len: 111 microversion: 2.1 time: 0.352582 Sep 11 01:00:53.977318 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 326/656] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:53 2022] GET /compute/v2.1/servers/67923a02-d1a5-4177-b7f3-15e4e795894a => generated 111 bytes in 355 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:00:53.991145 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f808d96b-7c3f-4105-99da-24bfef43871f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:53.992345 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f808d96b-7c3f-4105-99da-24bfef43871f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:54.000850 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f808d96b-7c3f-4105-99da-24bfef43871f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:54.001523 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f808d96b-7c3f-4105-99da-24bfef43871f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:54.001962 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f808d96b-7c3f-4105-99da-24bfef43871f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:54.002679 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f808d96b-7c3f-4105-99da-24bfef43871f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:54.003130 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f808d96b-7c3f-4105-99da-24bfef43871f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:54.003572 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f808d96b-7c3f-4105-99da-24bfef43871f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:54.042006 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f808d96b-7c3f-4105-99da-24bfef43871f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Going to try to terminate instance {{(pid=120497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 01:00:54.177476 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f808d96b-7c3f-4105-99da-24bfef43871f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 204 len: 0 microversion: 2.1 time: 0.201516 Sep 11 01:00:54.178305 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 331/657] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:00:53 2022] DELETE /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 01:00:54.187380 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f9171d33-c671-4780-a8cf-756a004aa2be tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:54.188330 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f9171d33-c671-4780-a8cf-756a004aa2be tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:54.195379 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9171d33-c671-4780-a8cf-756a004aa2be tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:54.196182 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9171d33-c671-4780-a8cf-756a004aa2be tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:54.197179 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9171d33-c671-4780-a8cf-756a004aa2be tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:54.198202 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9171d33-c671-4780-a8cf-756a004aa2be tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:54.198927 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9171d33-c671-4780-a8cf-756a004aa2be tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:54.199710 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9171d33-c671-4780-a8cf-756a004aa2be tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:54.400857 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f9171d33-c671-4780-a8cf-756a004aa2be tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:54.403487 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:54.411525 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f9171d33-c671-4780-a8cf-756a004aa2be tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.228910 Sep 11 01:00:54.412604 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 327/658] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:54 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:55.437677 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-92b4b7ae-9cb6-494c-ae3e-af886af5f50f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:55.438382 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-92b4b7ae-9cb6-494c-ae3e-af886af5f50f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:55.445322 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-92b4b7ae-9cb6-494c-ae3e-af886af5f50f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:55.446077 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-92b4b7ae-9cb6-494c-ae3e-af886af5f50f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:55.446675 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-92b4b7ae-9cb6-494c-ae3e-af886af5f50f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:55.447580 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-92b4b7ae-9cb6-494c-ae3e-af886af5f50f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:55.448233 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-92b4b7ae-9cb6-494c-ae3e-af886af5f50f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:55.448820 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-92b4b7ae-9cb6-494c-ae3e-af886af5f50f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:55.596751 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-92b4b7ae-9cb6-494c-ae3e-af886af5f50f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:55.606104 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-92b4b7ae-9cb6-494c-ae3e-af886af5f50f tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.172627 Sep 11 01:00:55.611066 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 332/659] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:55 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:56.349287 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-80f8e06d-860f-401f-95f5-14b76ae744c6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:56.349781 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-80f8e06d-860f-401f-95f5-14b76ae744c6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:56.359809 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80f8e06d-860f-401f-95f5-14b76ae744c6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:56.360300 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80f8e06d-860f-401f-95f5-14b76ae744c6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:56.360736 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80f8e06d-860f-401f-95f5-14b76ae744c6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:56.361647 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80f8e06d-860f-401f-95f5-14b76ae744c6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:56.361891 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80f8e06d-860f-401f-95f5-14b76ae744c6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:56.362322 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80f8e06d-860f-401f-95f5-14b76ae744c6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:56.390470 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-80f8e06d-860f-401f-95f5-14b76ae744c6 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908/ips" status: 200 len: 150 microversion: 2.20 time: 0.224321 Sep 11 01:00:56.391055 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 328/660] 10.222.0.23 () {60 vars in 1289 bytes} [Sun Sep 11 01:00:56 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908/ips => generated 150 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 01:00:56.643501 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b876d62f-2881-449d-a6e7-82dd9fec1038 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:56.645276 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-b876d62f-2881-449d-a6e7-82dd9fec1038 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:56.653394 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b876d62f-2881-449d-a6e7-82dd9fec1038 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:56.654256 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b876d62f-2881-449d-a6e7-82dd9fec1038 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:56.655370 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b876d62f-2881-449d-a6e7-82dd9fec1038 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:56.656544 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b876d62f-2881-449d-a6e7-82dd9fec1038 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:56.657237 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b876d62f-2881-449d-a6e7-82dd9fec1038 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:56.657866 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b876d62f-2881-449d-a6e7-82dd9fec1038 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:57.003471 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-b876d62f-2881-449d-a6e7-82dd9fec1038 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:57.007329 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-b876d62f-2881-449d-a6e7-82dd9fec1038 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.369097 Sep 11 01:00:57.007924 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 333/661] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:56 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:58.030164 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4171aaec-ed7f-4a21-a89a-81dfc972c339 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:58.031588 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4171aaec-ed7f-4a21-a89a-81dfc972c339 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:58.045780 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4171aaec-ed7f-4a21-a89a-81dfc972c339 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:58.046179 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4171aaec-ed7f-4a21-a89a-81dfc972c339 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:58.046608 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4171aaec-ed7f-4a21-a89a-81dfc972c339 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:58.047380 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4171aaec-ed7f-4a21-a89a-81dfc972c339 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:58.051833 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4171aaec-ed7f-4a21-a89a-81dfc972c339 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:58.052499 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4171aaec-ed7f-4a21-a89a-81dfc972c339 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:58.296256 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4171aaec-ed7f-4a21-a89a-81dfc972c339 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:58.304783 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4171aaec-ed7f-4a21-a89a-81dfc972c339 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1520 microversion: 2.1 time: 0.278639 Sep 11 01:00:58.319724 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 329/662] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:58 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:00:58.479366 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-20fb975c-0e99-42cf-a606-e2db3f5c0c17 req-2fc53272-4c15-4593-afd0-5c54dd926835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda4760f-be50-4efe-808f-d4ab2c0358f4", "name": "network-vif-deleted", "tag": "0a23eaa3-e9b6-4004-81da-c5fb16fac3ac"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:58.512281 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-20fb975c-0e99-42cf-a606-e2db3f5c0c17 req-2fc53272-4c15-4593-afd0-5c54dd926835 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:58.513031 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-20fb975c-0e99-42cf-a606-e2db3f5c0c17 req-2fc53272-4c15-4593-afd0-5c54dd926835 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:58.513616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-20fb975c-0e99-42cf-a606-e2db3f5c0c17 req-2fc53272-4c15-4593-afd0-5c54dd926835 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:58.543994 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-20fb975c-0e99-42cf-a606-e2db3f5c0c17 req-2fc53272-4c15-4593-afd0-5c54dd926835 service nova] Creating event network-vif-deleted:0a23eaa3-e9b6-4004-81da-c5fb16fac3ac for instance eda4760f-be50-4efe-808f-d4ab2c0358f4 on hv-cinder-maste Sep 11 01:00:58.561417 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-20fb975c-0e99-42cf-a606-e2db3f5c0c17 req-2fc53272-4c15-4593-afd0-5c54dd926835 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085812 Sep 11 01:00:58.562207 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 334/663] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:00:58.583264 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a6833675-86b6-4b2e-b172-661e46d51bc1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:00:58.583879 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a6833675-86b6-4b2e-b172-661e46d51bc1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:58.590309 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a6833675-86b6-4b2e-b172-661e46d51bc1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:58.591221 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a6833675-86b6-4b2e-b172-661e46d51bc1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:58.591930 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a6833675-86b6-4b2e-b172-661e46d51bc1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:58.592980 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a6833675-86b6-4b2e-b172-661e46d51bc1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:58.593651 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a6833675-86b6-4b2e-b172-661e46d51bc1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:58.594075 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a6833675-86b6-4b2e-b172-661e46d51bc1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:58.626766 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-a6833675-86b6-4b2e-b172-661e46d51bc1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lazy-loading 'flavor' on Instance uuid bff12074-d8b0-4beb-9ddb-6e617f654908 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:00:58.981340 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a6833675-86b6-4b2e-b172-661e46d51bc1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "POST /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908/action" status: 202 len: 0 microversion: 2.20 time: 0.401797 Sep 11 01:00:58.981987 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 330/664] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Sep 11 01:00:58 2022] POST /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 11 01:00:58.996989 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-1d6b2e38-8d0e-45a7-91b3-75e4cffd4d35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:58.997942 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-1d6b2e38-8d0e-45a7-91b3-75e4cffd4d35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:59.017966 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1d6b2e38-8d0e-45a7-91b3-75e4cffd4d35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:59.024210 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1d6b2e38-8d0e-45a7-91b3-75e4cffd4d35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:59.024740 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1d6b2e38-8d0e-45a7-91b3-75e4cffd4d35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:59.025565 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1d6b2e38-8d0e-45a7-91b3-75e4cffd4d35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:59.026266 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1d6b2e38-8d0e-45a7-91b3-75e4cffd4d35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:59.026876 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1d6b2e38-8d0e-45a7-91b3-75e4cffd4d35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:59.186760 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1d6b2e38-8d0e-45a7-91b3-75e4cffd4d35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:59.196847 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1d6b2e38-8d0e-45a7-91b3-75e4cffd4d35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:59.198576 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1d6b2e38-8d0e-45a7-91b3-75e4cffd4d35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:59.200009 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-1d6b2e38-8d0e-45a7-91b3-75e4cffd4d35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.211507 Sep 11 01:00:59.200568 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 335/665] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:00:58 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:00:59.329105 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-38955274-e2d1-42dd-a18b-d57a275c8adb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:00:59.329799 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-38955274-e2d1-42dd-a18b-d57a275c8adb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:00:59.340647 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38955274-e2d1-42dd-a18b-d57a275c8adb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:59.341266 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38955274-e2d1-42dd-a18b-d57a275c8adb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:59.341922 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38955274-e2d1-42dd-a18b-d57a275c8adb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:59.343008 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38955274-e2d1-42dd-a18b-d57a275c8adb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:59.344561 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38955274-e2d1-42dd-a18b-d57a275c8adb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:59.345220 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38955274-e2d1-42dd-a18b-d57a275c8adb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:59.385137 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38955274-e2d1-42dd-a18b-d57a275c8adb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:00:59.385731 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38955274-e2d1-42dd-a18b-d57a275c8adb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:00:59.386232 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38955274-e2d1-42dd-a18b-d57a275c8adb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:00:59.387066 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-38955274-e2d1-42dd-a18b-d57a275c8adb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lazy-loading 'fault' on Instance uuid eda4760f-be50-4efe-808f-d4ab2c0358f4 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:00:59.449067 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-38955274-e2d1-42dd-a18b-d57a275c8adb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03a3c989ecef42e084fb44d47c55b27e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8c0850e1ac43e7913a88dbb7b7e9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:00:59.457077 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-38955274-e2d1-42dd-a18b-d57a275c8adb tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 200 len: 1311 microversion: 2.1 time: 0.132125 Sep 11 01:00:59.457894 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 331/666] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:00:59 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 1311 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:00.230342 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d4640037-cf80-4751-8cd5-beaed4b527e3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:00.231129 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d4640037-cf80-4751-8cd5-beaed4b527e3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:00.238628 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d4640037-cf80-4751-8cd5-beaed4b527e3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:00.239525 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d4640037-cf80-4751-8cd5-beaed4b527e3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:00.240362 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d4640037-cf80-4751-8cd5-beaed4b527e3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:00.241596 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d4640037-cf80-4751-8cd5-beaed4b527e3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:00.242197 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d4640037-cf80-4751-8cd5-beaed4b527e3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:00.242713 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d4640037-cf80-4751-8cd5-beaed4b527e3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:00.401388 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d4640037-cf80-4751-8cd5-beaed4b527e3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:00.410757 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d4640037-cf80-4751-8cd5-beaed4b527e3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:00.412364 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d4640037-cf80-4751-8cd5-beaed4b527e3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:00.413462 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d4640037-cf80-4751-8cd5-beaed4b527e3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.189653 Sep 11 01:01:00.414580 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 336/667] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:00 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:00.482553 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-91cd6f21-ba34-482a-90da-2cb4109ccdc7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:00.483215 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-91cd6f21-ba34-482a-90da-2cb4109ccdc7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] [instance: eda4760f-be50-4efe-808f-d4ab2c0358f4] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:00.489723 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-91cd6f21-ba34-482a-90da-2cb4109ccdc7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:00.490241 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-91cd6f21-ba34-482a-90da-2cb4109ccdc7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:00.490644 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-91cd6f21-ba34-482a-90da-2cb4109ccdc7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:00.491544 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-91cd6f21-ba34-482a-90da-2cb4109ccdc7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:00.492172 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-91cd6f21-ba34-482a-90da-2cb4109ccdc7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:00.492876 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-91cd6f21-ba34-482a-90da-2cb4109ccdc7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:00.511341 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-91cd6f21-ba34-482a-90da-2cb4109ccdc7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] HTTP exception thrown: Instance eda4760f-be50-4efe-808f-d4ab2c0358f4 could not be found. Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-91cd6f21-ba34-482a-90da-2cb4109ccdc7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Request method failure captured: Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 HTTP/1.1 Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIZV3OGXS0Y0dMCJR3JsNV5yeizCzXf9d_TuViBBFaAqgn8TDP7z7jkssGhxEzL2Hkj8d0DyUdQPhy8rCBCc-PskzFupuPpZKa-RVGVZcBl67AuQkQbqQObAzrPZ5DBpyPNMKv8zeY6EtLRNUIutKSaCaDQe1MRr7gfF_WIm51FEcc Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: ac8c0850e1ac43e7913a88dbb7b7e9f8 Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:01:00.513019 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:01:00.514743 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8c0850e1ac43e7913a88dbb7b7e9f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8c0850e1ac43e7913a88dbb7b7e9f8", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:00.514743 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 01:01:00.514743 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: ac8c0850e1ac43e7913a88dbb7b7e9f8 Sep 11 01:01:00.514743 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2141619617 Sep 11 01:01:00.514743 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-ServerRescueNegativeTestJSON-2141619617-project Sep 11 01:01:00.514743 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:01:00.514743 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:01:00.514743 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 03a3c989ecef42e084fb44d47c55b27e Sep 11 01:01:00.514743 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2141619617-project Sep 11 01:01:00.514743 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:01:00.514743 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance eda4760f-be50-4efe-808f-d4ab2c0358f4 could not be found. Sep 11 01:01:00.514743 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': 'eda4760f-be50-4efe-808f-d4ab2c0358f4'} Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eda4760f-be50-4efe-808f-d4ab2c0358f4 could not be found. Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:00.515686 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eda4760f-be50-4efe-808f-d4ab2c0358f4 could not be found. Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eda4760f-be50-4efe-808f-d4ab2c0358f4 could not be found. Sep 11 01:01:00.517115 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:00.519143 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-91cd6f21-ba34-482a-90da-2cb4109ccdc7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] Returning 404 to user: Instance eda4760f-be50-4efe-808f-d4ab2c0358f4 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:00.520062 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-91cd6f21-ba34-482a-90da-2cb4109ccdc7 tempest-ServerRescueNegativeTestJSON-2141619617 tempest-ServerRescueNegativeTestJSON-2141619617-project] 10.222.0.23 "GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4" status: 404 len: 111 microversion: 2.1 time: 0.042350 Sep 11 01:01:00.525272 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 332/668] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:00 2022] GET /compute/v2.1/servers/eda4760f-be50-4efe-808f-d4ab2c0358f4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:01:01.441598 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-36ef0777-ea58-4999-be38-3b2c4135b905 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:01.442510 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-36ef0777-ea58-4999-be38-3b2c4135b905 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:01.458555 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36ef0777-ea58-4999-be38-3b2c4135b905 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:01.459443 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36ef0777-ea58-4999-be38-3b2c4135b905 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:01.460195 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36ef0777-ea58-4999-be38-3b2c4135b905 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:01.461132 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36ef0777-ea58-4999-be38-3b2c4135b905 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:01.461788 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36ef0777-ea58-4999-be38-3b2c4135b905 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:01.462442 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36ef0777-ea58-4999-be38-3b2c4135b905 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:01.614379 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-36ef0777-ea58-4999-be38-3b2c4135b905 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:01.617891 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:01.630992 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-36ef0777-ea58-4999-be38-3b2c4135b905 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:01.632680 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-36ef0777-ea58-4999-be38-3b2c4135b905 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:01.634060 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-36ef0777-ea58-4999-be38-3b2c4135b905 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.198698 Sep 11 01:01:01.652501 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 337/669] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:01 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:02.660224 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-93db099e-0757-463c-af65-00917a0f5da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:02.660841 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-93db099e-0757-463c-af65-00917a0f5da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:02.673273 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-93db099e-0757-463c-af65-00917a0f5da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:02.674161 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-93db099e-0757-463c-af65-00917a0f5da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:02.675063 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-93db099e-0757-463c-af65-00917a0f5da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:02.680900 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-93db099e-0757-463c-af65-00917a0f5da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:02.683332 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-93db099e-0757-463c-af65-00917a0f5da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:02.684663 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-93db099e-0757-463c-af65-00917a0f5da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:02.849519 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-93db099e-0757-463c-af65-00917a0f5da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:02.859156 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-93db099e-0757-463c-af65-00917a0f5da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:02.861306 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-93db099e-0757-463c-af65-00917a0f5da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:02.862647 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-93db099e-0757-463c-af65-00917a0f5da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.206583 Sep 11 01:01:02.875816 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 333/670] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:02 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:03.338055 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-67d59822-d6ce-494b-bb2b-f6f9d455a4eb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Action: 'create', calling method: .version_select at 0x7fbb906f9940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-534682617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+CI0xyIBEnj0akg9xwRPLeDetStycXbKPlt998cs+73dIs0FqWa588NND/dwNxhnueSCu20ezYaU3UKjDkdLBb8q6YXl5WhIXx5u2HvxSp7QoLbOj2GNytMWoQMWkBsQ=="}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:03.355901 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-67d59822-d6ce-494b-bb2b-f6f9d455a4eb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Getting quotas for project 69a25da8ed8849bba71977e48ec7bd8d. Resources: {'key_pairs'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 01:01:03.360233 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-67d59822-d6ce-494b-bb2b-f6f9d455a4eb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Getting quotas for user b0ba6f92b3d34bbeb1f7d52de32cd29c and project 69a25da8ed8849bba71977e48ec7bd8d. Resources: {'key_pairs'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 01:01:03.384073 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-67d59822-d6ce-494b-bb2b-f6f9d455a4eb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051029 Sep 11 01:01:03.384782 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 338/671] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Sep 11 01:01:03 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:01:03.437088 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1870071020", "imageRef": "71a00385-7ea5-4629-9879-6e438a7fe63b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-534682617", "networks": [{"uuid": "75a61f5a-94b4-4917-a040-ea2aa7bc175a"}]}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:03.490371 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] validate_networks() for [('75a61f5a-94b4-4917-a040-ea2aa7bc175a', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 01:01:03.890784 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0921968d-d492-4a68-ab75-6724f3ea4029 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:03.891507 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-0921968d-d492-4a68-ab75-6724f3ea4029 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:03.898453 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0921968d-d492-4a68-ab75-6724f3ea4029 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:03.899072 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0921968d-d492-4a68-ab75-6724f3ea4029 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:03.899640 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0921968d-d492-4a68-ab75-6724f3ea4029 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:03.900693 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0921968d-d492-4a68-ab75-6724f3ea4029 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:03.901335 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0921968d-d492-4a68-ab75-6724f3ea4029 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:03.901837 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0921968d-d492-4a68-ab75-6724f3ea4029 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:04.215925 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0921968d-d492-4a68-ab75-6724f3ea4029 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:04.232040 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0921968d-d492-4a68-ab75-6724f3ea4029 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:04.234690 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0921968d-d492-4a68-ab75-6724f3ea4029 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:04.238503 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0921968d-d492-4a68-ab75-6724f3ea4029 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.353014 Sep 11 01:01:04.240042 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 339/672] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:03 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:04.314017 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 01:01:04.314469 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 01:01:04.315459 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 01:01:04.315763 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 01:01:04.316156 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 01:01:04.325531 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:04.326566 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:04.326860 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:04.327638 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:04.328268 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:04.328702 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:04.351946 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Getting quotas for project 69a25da8ed8849bba71977e48ec7bd8d. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 01:01:04.356212 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Getting quotas for user b0ba6f92b3d34bbeb1f7d52de32cd29c and project 69a25da8ed8849bba71977e48ec7bd8d. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 01:01:04.367001 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 01:01:04.369291 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71a00385-7ea5-4629-9879-6e438a7fe63b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 01:01:04.414870 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-47e4addd-e9b5-4673-a1f1-f9db644479f2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.981677 Sep 11 01:01:04.419336 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 334/673] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 01:01:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 01:01:04.426612 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d2ef40d9-09cb-4112-83cf-e28aa473a61e tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:04.427802 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d2ef40d9-09cb-4112-83cf-e28aa473a61e tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:04.539604 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d2ef40d9-09cb-4112-83cf-e28aa473a61e tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:04.546640 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d2ef40d9-09cb-4112-83cf-e28aa473a61e tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1258 microversion: 2.1 time: 0.123698 Sep 11 01:01:04.547103 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 340/674] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:04 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1258 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:01:05.264854 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2f8cdaf6-8109-4e2f-8928-27be08dafe13 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:05.265726 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2f8cdaf6-8109-4e2f-8928-27be08dafe13 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:05.273208 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2f8cdaf6-8109-4e2f-8928-27be08dafe13 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:05.273934 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2f8cdaf6-8109-4e2f-8928-27be08dafe13 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:05.274536 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2f8cdaf6-8109-4e2f-8928-27be08dafe13 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:05.275475 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2f8cdaf6-8109-4e2f-8928-27be08dafe13 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:05.275928 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2f8cdaf6-8109-4e2f-8928-27be08dafe13 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:05.276473 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2f8cdaf6-8109-4e2f-8928-27be08dafe13 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:05.422635 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-2f8cdaf6-8109-4e2f-8928-27be08dafe13 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:05.434818 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-2f8cdaf6-8109-4e2f-8928-27be08dafe13 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:05.437124 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-2f8cdaf6-8109-4e2f-8928-27be08dafe13 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:05.438814 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2f8cdaf6-8109-4e2f-8928-27be08dafe13 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.178490 Sep 11 01:01:05.439412 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 335/675] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:05 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 01:01:05.569196 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-538af41a-a5a8-4789-a992-6658d61c73b6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:05.569928 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-538af41a-a5a8-4789-a992-6658d61c73b6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:05.576855 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-538af41a-a5a8-4789-a992-6658d61c73b6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:05.577346 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-538af41a-a5a8-4789-a992-6658d61c73b6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:05.577782 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-538af41a-a5a8-4789-a992-6658d61c73b6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:05.578475 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-538af41a-a5a8-4789-a992-6658d61c73b6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:05.578926 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-538af41a-a5a8-4789-a992-6658d61c73b6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:05.579388 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-538af41a-a5a8-4789-a992-6658d61c73b6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:05.641537 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-538af41a-a5a8-4789-a992-6658d61c73b6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:05.654300 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-538af41a-a5a8-4789-a992-6658d61c73b6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1310 microversion: 2.1 time: 0.084846 Sep 11 01:01:05.654300 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 341/676] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:05 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:06.467879 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5f0dce52-94f0-4fa3-ade7-f42c47d7198b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:06.469415 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5f0dce52-94f0-4fa3-ade7-f42c47d7198b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:06.479054 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5f0dce52-94f0-4fa3-ade7-f42c47d7198b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:06.480636 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5f0dce52-94f0-4fa3-ade7-f42c47d7198b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:06.484398 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5f0dce52-94f0-4fa3-ade7-f42c47d7198b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:06.485217 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5f0dce52-94f0-4fa3-ade7-f42c47d7198b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:06.486190 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5f0dce52-94f0-4fa3-ade7-f42c47d7198b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:06.486622 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5f0dce52-94f0-4fa3-ade7-f42c47d7198b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:06.673822 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3142402e-6d6e-41da-8e79-a195aec46fa2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:06.674488 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3142402e-6d6e-41da-8e79-a195aec46fa2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:06.678303 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:06.695765 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3142402e-6d6e-41da-8e79-a195aec46fa2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:06.696255 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3142402e-6d6e-41da-8e79-a195aec46fa2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:06.696688 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3142402e-6d6e-41da-8e79-a195aec46fa2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:06.697398 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3142402e-6d6e-41da-8e79-a195aec46fa2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:06.697841 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3142402e-6d6e-41da-8e79-a195aec46fa2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:06.698278 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3142402e-6d6e-41da-8e79-a195aec46fa2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:06.785760 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-5f0dce52-94f0-4fa3-ade7-f42c47d7198b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:06.805741 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-5f0dce52-94f0-4fa3-ade7-f42c47d7198b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:06.808078 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-5f0dce52-94f0-4fa3-ade7-f42c47d7198b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:06.809279 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5f0dce52-94f0-4fa3-ade7-f42c47d7198b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.349276 Sep 11 01:01:06.809831 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 336/677] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:06 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:07.050905 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3142402e-6d6e-41da-8e79-a195aec46fa2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:07.064005 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3142402e-6d6e-41da-8e79-a195aec46fa2 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1358 microversion: 2.1 time: 0.394536 Sep 11 01:01:07.070032 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 342/678] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:06 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1358 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:07.841361 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1280b9b1-3d98-4776-9009-4c741d8c7714 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:07.842046 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1280b9b1-3d98-4776-9009-4c741d8c7714 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:07.851910 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1280b9b1-3d98-4776-9009-4c741d8c7714 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:07.852559 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1280b9b1-3d98-4776-9009-4c741d8c7714 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:07.852998 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1280b9b1-3d98-4776-9009-4c741d8c7714 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:07.853784 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1280b9b1-3d98-4776-9009-4c741d8c7714 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:07.854449 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1280b9b1-3d98-4776-9009-4c741d8c7714 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:07.854981 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1280b9b1-3d98-4776-9009-4c741d8c7714 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:07.871246 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-a5263e4d-7af9-4dc3-abd2-37f4648ca664 req-7e9928f8-01af-4987-942c-101c5bbc774d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65943bbe-32ae-424f-8341-ddf47713744f", "tag": "b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:07.909678 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-a5263e4d-7af9-4dc3-abd2-37f4648ca664 req-7e9928f8-01af-4987-942c-101c5bbc774d service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:07.910159 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-a5263e4d-7af9-4dc3-abd2-37f4648ca664 req-7e9928f8-01af-4987-942c-101c5bbc774d service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:07.910583 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-a5263e4d-7af9-4dc3-abd2-37f4648ca664 req-7e9928f8-01af-4987-942c-101c5bbc774d service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:07.935529 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-a5263e4d-7af9-4dc3-abd2-37f4648ca664 req-7e9928f8-01af-4987-942c-101c5bbc774d service nova] Creating event network-changed:b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71 for instance 65943bbe-32ae-424f-8341-ddf47713744f on hv-cinder-maste Sep 11 01:01:07.947067 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-a5263e4d-7af9-4dc3-abd2-37f4648ca664 req-7e9928f8-01af-4987-942c-101c5bbc774d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080635 Sep 11 01:01:07.959933 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 343/679] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:01:08.068836 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1280b9b1-3d98-4776-9009-4c741d8c7714 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:08.077469 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1280b9b1-3d98-4776-9009-4c741d8c7714 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:08.079062 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1280b9b1-3d98-4776-9009-4c741d8c7714 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:08.080562 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1280b9b1-3d98-4776-9009-4c741d8c7714 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.247390 Sep 11 01:01:08.081199 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 337/680] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:07 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:08.101932 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-367fde36-02b1-41b4-b504-e1ce9889cf72 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:08.102927 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-367fde36-02b1-41b4-b504-e1ce9889cf72 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:08.110066 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-367fde36-02b1-41b4-b504-e1ce9889cf72 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:08.110812 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-367fde36-02b1-41b4-b504-e1ce9889cf72 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:08.111424 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-367fde36-02b1-41b4-b504-e1ce9889cf72 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:08.112920 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-367fde36-02b1-41b4-b504-e1ce9889cf72 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:08.113806 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-367fde36-02b1-41b4-b504-e1ce9889cf72 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:08.114383 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-367fde36-02b1-41b4-b504-e1ce9889cf72 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:08.299405 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-367fde36-02b1-41b4-b504-e1ce9889cf72 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:08.307900 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-367fde36-02b1-41b4-b504-e1ce9889cf72 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1358 microversion: 2.1 time: 0.210698 Sep 11 01:01:08.308844 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 344/681] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:08 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:09.110548 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1bc71270-1208-4555-8556-362b6bfe85c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:09.111287 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1bc71270-1208-4555-8556-362b6bfe85c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:09.118223 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1bc71270-1208-4555-8556-362b6bfe85c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:09.118697 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1bc71270-1208-4555-8556-362b6bfe85c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:09.119132 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1bc71270-1208-4555-8556-362b6bfe85c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:09.120369 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1bc71270-1208-4555-8556-362b6bfe85c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:09.120827 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1bc71270-1208-4555-8556-362b6bfe85c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:09.121248 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1bc71270-1208-4555-8556-362b6bfe85c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:09.309587 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1bc71270-1208-4555-8556-362b6bfe85c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:09.318614 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1bc71270-1208-4555-8556-362b6bfe85c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:09.320309 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1bc71270-1208-4555-8556-362b6bfe85c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:09.321544 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1bc71270-1208-4555-8556-362b6bfe85c0 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.215392 Sep 11 01:01:09.322288 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 338/682] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:09 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:09.336442 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6dd80043-90f4-44c2-ba72-276cc9636758 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:09.337652 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6dd80043-90f4-44c2-ba72-276cc9636758 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:09.347596 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6dd80043-90f4-44c2-ba72-276cc9636758 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:09.348353 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6dd80043-90f4-44c2-ba72-276cc9636758 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:09.349023 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6dd80043-90f4-44c2-ba72-276cc9636758 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:09.350057 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6dd80043-90f4-44c2-ba72-276cc9636758 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:09.350657 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6dd80043-90f4-44c2-ba72-276cc9636758 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:09.351386 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6dd80043-90f4-44c2-ba72-276cc9636758 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:09.498818 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6dd80043-90f4-44c2-ba72-276cc9636758 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:09.508647 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6dd80043-90f4-44c2-ba72-276cc9636758 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1358 microversion: 2.1 time: 0.175555 Sep 11 01:01:09.520200 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 345/683] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:09 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:10.346915 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b89a4d58-3f54-4d55-8433-569bc6379a2d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:10.347875 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b89a4d58-3f54-4d55-8433-569bc6379a2d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:10.355281 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b89a4d58-3f54-4d55-8433-569bc6379a2d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:10.355776 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b89a4d58-3f54-4d55-8433-569bc6379a2d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:10.356247 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b89a4d58-3f54-4d55-8433-569bc6379a2d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:10.357120 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b89a4d58-3f54-4d55-8433-569bc6379a2d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:10.357952 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b89a4d58-3f54-4d55-8433-569bc6379a2d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:10.358834 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b89a4d58-3f54-4d55-8433-569bc6379a2d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:10.533527 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d66678dc-9e14-4576-bce5-2d7b768963f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:10.534062 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d66678dc-9e14-4576-bce5-2d7b768963f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:10.543126 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d66678dc-9e14-4576-bce5-2d7b768963f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:10.543979 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d66678dc-9e14-4576-bce5-2d7b768963f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:10.544411 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d66678dc-9e14-4576-bce5-2d7b768963f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:10.545278 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d66678dc-9e14-4576-bce5-2d7b768963f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:10.545729 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d66678dc-9e14-4576-bce5-2d7b768963f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:10.546149 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d66678dc-9e14-4576-bce5-2d7b768963f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:10.850134 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b89a4d58-3f54-4d55-8433-569bc6379a2d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:10.859882 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b89a4d58-3f54-4d55-8433-569bc6379a2d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:10.861325 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b89a4d58-3f54-4d55-8433-569bc6379a2d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:10.862495 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b89a4d58-3f54-4d55-8433-569bc6379a2d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.520402 Sep 11 01:01:10.863092 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 339/684] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:10 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:10.874243 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d66678dc-9e14-4576-bce5-2d7b768963f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:10.883737 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d66678dc-9e14-4576-bce5-2d7b768963f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1358 microversion: 2.1 time: 0.354240 Sep 11 01:01:10.891216 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 346/685] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:10 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1358 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:01:11.891887 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a0304ef4-153a-4229-a4a6-7c0eeb3f5602 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:11.892654 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a0304ef4-153a-4229-a4a6-7c0eeb3f5602 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:11.898361 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:11.905747 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0304ef4-153a-4229-a4a6-7c0eeb3f5602 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:11.906330 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0304ef4-153a-4229-a4a6-7c0eeb3f5602 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:11.906878 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0304ef4-153a-4229-a4a6-7c0eeb3f5602 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:11.908330 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a1086831-a63c-4aad-baac-178fe756eb66 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:11.908986 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a1086831-a63c-4aad-baac-178fe756eb66 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:11.914098 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0304ef4-153a-4229-a4a6-7c0eeb3f5602 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:11.914795 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0304ef4-153a-4229-a4a6-7c0eeb3f5602 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:11.915492 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a0304ef4-153a-4229-a4a6-7c0eeb3f5602 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:11.919629 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1086831-a63c-4aad-baac-178fe756eb66 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:11.920129 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1086831-a63c-4aad-baac-178fe756eb66 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:11.920571 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1086831-a63c-4aad-baac-178fe756eb66 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:11.921284 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1086831-a63c-4aad-baac-178fe756eb66 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:11.921732 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1086831-a63c-4aad-baac-178fe756eb66 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:11.922215 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1086831-a63c-4aad-baac-178fe756eb66 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:12.164584 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a1086831-a63c-4aad-baac-178fe756eb66 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:12.167313 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a0304ef4-153a-4229-a4a6-7c0eeb3f5602 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:12.174956 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a1086831-a63c-4aad-baac-178fe756eb66 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1358 microversion: 2.1 time: 0.271306 Sep 11 01:01:12.182255 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 347/686] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:11 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:12.182491 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a0304ef4-153a-4229-a4a6-7c0eeb3f5602 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:12.182491 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a0304ef4-153a-4229-a4a6-7c0eeb3f5602 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:12.182491 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a0304ef4-153a-4229-a4a6-7c0eeb3f5602 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.294811 Sep 11 01:01:12.182806 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 340/687] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:11 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 01:01:13.205429 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1e55d354-42ce-4ff4-9c74-1b1591f444fe tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:13.206188 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1e55d354-42ce-4ff4-9c74-1b1591f444fe tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:13.206575 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ff0991ba-78b2-449d-b028-6bc7f29e76d7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:13.209383 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ff0991ba-78b2-449d-b028-6bc7f29e76d7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:13.219999 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e55d354-42ce-4ff4-9c74-1b1591f444fe tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:13.221858 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e55d354-42ce-4ff4-9c74-1b1591f444fe tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:13.222303 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e55d354-42ce-4ff4-9c74-1b1591f444fe tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:13.226323 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ff0991ba-78b2-449d-b028-6bc7f29e76d7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:13.226811 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ff0991ba-78b2-449d-b028-6bc7f29e76d7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:13.227258 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ff0991ba-78b2-449d-b028-6bc7f29e76d7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:13.227957 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ff0991ba-78b2-449d-b028-6bc7f29e76d7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:13.228414 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ff0991ba-78b2-449d-b028-6bc7f29e76d7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:13.228811 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ff0991ba-78b2-449d-b028-6bc7f29e76d7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:13.230901 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e55d354-42ce-4ff4-9c74-1b1591f444fe tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:13.231472 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e55d354-42ce-4ff4-9c74-1b1591f444fe tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:13.231906 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e55d354-42ce-4ff4-9c74-1b1591f444fe tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:13.611078 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ff0991ba-78b2-449d-b028-6bc7f29e76d7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:13.627421 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ff0991ba-78b2-449d-b028-6bc7f29e76d7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1358 microversion: 2.1 time: 0.432942 Sep 11 01:01:13.628579 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 348/688] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:13 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1358 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:13.671193 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1e55d354-42ce-4ff4-9c74-1b1591f444fe tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:13.681347 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1e55d354-42ce-4ff4-9c74-1b1591f444fe tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:13.683913 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1e55d354-42ce-4ff4-9c74-1b1591f444fe tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:13.685802 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1e55d354-42ce-4ff4-9c74-1b1591f444fe tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.484685 Sep 11 01:01:13.686913 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 341/689] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:13 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:14.650573 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-caa57ff5-0737-416e-b72d-112e565621cd tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:14.652137 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-caa57ff5-0737-416e-b72d-112e565621cd tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:14.658810 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=6 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:14.661525 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-caa57ff5-0737-416e-b72d-112e565621cd tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:14.662261 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-caa57ff5-0737-416e-b72d-112e565621cd tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:14.662688 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-caa57ff5-0737-416e-b72d-112e565621cd tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:14.663427 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-caa57ff5-0737-416e-b72d-112e565621cd tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:14.664232 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-caa57ff5-0737-416e-b72d-112e565621cd tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:14.664645 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-caa57ff5-0737-416e-b72d-112e565621cd tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:14.738094 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a51e0a11-9fa9-4bad-a20a-203b7397cf4e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:14.738797 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a51e0a11-9fa9-4bad-a20a-203b7397cf4e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:14.742244 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:14.744495 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=6 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:14.751611 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a51e0a11-9fa9-4bad-a20a-203b7397cf4e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:14.752081 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a51e0a11-9fa9-4bad-a20a-203b7397cf4e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:14.752704 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a51e0a11-9fa9-4bad-a20a-203b7397cf4e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:14.753596 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a51e0a11-9fa9-4bad-a20a-203b7397cf4e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:14.754195 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a51e0a11-9fa9-4bad-a20a-203b7397cf4e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:14.754771 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a51e0a11-9fa9-4bad-a20a-203b7397cf4e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:14.848516 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-caa57ff5-0737-416e-b72d-112e565621cd tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:14.857998 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-caa57ff5-0737-416e-b72d-112e565621cd tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1358 microversion: 2.1 time: 0.211736 Sep 11 01:01:14.858878 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 349/690] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:14 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:14.923700 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a51e0a11-9fa9-4bad-a20a-203b7397cf4e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:14.932659 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a51e0a11-9fa9-4bad-a20a-203b7397cf4e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:14.934873 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a51e0a11-9fa9-4bad-a20a-203b7397cf4e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:14.945310 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a51e0a11-9fa9-4bad-a20a-203b7397cf4e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.211817 Sep 11 01:01:14.946336 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 342/691] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:14 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 01:01:15.886376 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-252adf5c-e96f-481f-8a96-d19cf559f170 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:15.887384 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-252adf5c-e96f-481f-8a96-d19cf559f170 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:15.898277 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-252adf5c-e96f-481f-8a96-d19cf559f170 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:15.899073 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-252adf5c-e96f-481f-8a96-d19cf559f170 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:15.899846 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-252adf5c-e96f-481f-8a96-d19cf559f170 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:15.901117 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-252adf5c-e96f-481f-8a96-d19cf559f170 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:15.901592 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-252adf5c-e96f-481f-8a96-d19cf559f170 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:15.902014 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-252adf5c-e96f-481f-8a96-d19cf559f170 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:15.973286 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b806d304-12bd-4d38-aab7-5a0d8c076295 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:15.973904 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b806d304-12bd-4d38-aab7-5a0d8c076295 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:15.982672 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b806d304-12bd-4d38-aab7-5a0d8c076295 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:15.983933 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b806d304-12bd-4d38-aab7-5a0d8c076295 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:15.984097 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b806d304-12bd-4d38-aab7-5a0d8c076295 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:15.985205 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b806d304-12bd-4d38-aab7-5a0d8c076295 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:15.986745 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b806d304-12bd-4d38-aab7-5a0d8c076295 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:15.987261 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b806d304-12bd-4d38-aab7-5a0d8c076295 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:16.064273 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-252adf5c-e96f-481f-8a96-d19cf559f170 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:16.071939 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-252adf5c-e96f-481f-8a96-d19cf559f170 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1358 microversion: 2.1 time: 0.192112 Sep 11 01:01:16.072533 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 350/692] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:15 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:16.141030 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b806d304-12bd-4d38-aab7-5a0d8c076295 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:16.143430 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:16.151116 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b806d304-12bd-4d38-aab7-5a0d8c076295 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:16.152669 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b806d304-12bd-4d38-aab7-5a0d8c076295 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:16.153825 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b806d304-12bd-4d38-aab7-5a0d8c076295 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.185199 Sep 11 01:01:16.154501 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 343/693] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:15 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 01:01:17.094650 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a532a68f-07aa-4b09-9bd2-8198ac2b620a tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:17.095336 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a532a68f-07aa-4b09-9bd2-8198ac2b620a tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:17.102662 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a532a68f-07aa-4b09-9bd2-8198ac2b620a tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:17.103140 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a532a68f-07aa-4b09-9bd2-8198ac2b620a tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:17.103627 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a532a68f-07aa-4b09-9bd2-8198ac2b620a tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:17.104407 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a532a68f-07aa-4b09-9bd2-8198ac2b620a tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:17.104849 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a532a68f-07aa-4b09-9bd2-8198ac2b620a tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:17.105266 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a532a68f-07aa-4b09-9bd2-8198ac2b620a tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:17.181306 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3301e181-3595-4234-9c20-71120e9aee23 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:17.181901 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3301e181-3595-4234-9c20-71120e9aee23 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:17.189399 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3301e181-3595-4234-9c20-71120e9aee23 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:17.189869 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3301e181-3595-4234-9c20-71120e9aee23 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:17.190289 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3301e181-3595-4234-9c20-71120e9aee23 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:17.190977 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3301e181-3595-4234-9c20-71120e9aee23 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:17.191439 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3301e181-3595-4234-9c20-71120e9aee23 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:17.191854 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3301e181-3595-4234-9c20-71120e9aee23 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:17.355811 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a532a68f-07aa-4b09-9bd2-8198ac2b620a tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:17.364327 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a532a68f-07aa-4b09-9bd2-8198ac2b620a tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1358 microversion: 2.1 time: 0.273506 Sep 11 01:01:17.365369 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 351/694] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:17 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:17.387100 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3301e181-3595-4234-9c20-71120e9aee23 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:17.395452 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3301e181-3595-4234-9c20-71120e9aee23 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:17.396893 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3301e181-3595-4234-9c20-71120e9aee23 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:17.398046 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3301e181-3595-4234-9c20-71120e9aee23 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1741 microversion: 2.20 time: 0.221855 Sep 11 01:01:17.398607 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 344/695] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:17 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 01:01:18.388027 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8052d6af-56b9-48cd-bf05-a281750754ae tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:18.388736 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-8052d6af-56b9-48cd-bf05-a281750754ae tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:18.395784 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8052d6af-56b9-48cd-bf05-a281750754ae tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:18.396272 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8052d6af-56b9-48cd-bf05-a281750754ae tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:18.396771 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8052d6af-56b9-48cd-bf05-a281750754ae tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:18.397538 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8052d6af-56b9-48cd-bf05-a281750754ae tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:18.397991 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8052d6af-56b9-48cd-bf05-a281750754ae tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:18.398402 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8052d6af-56b9-48cd-bf05-a281750754ae tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:18.424987 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-015f4c21-4c4f-44bd-b89d-76001c7db1ca tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:18.426344 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-015f4c21-4c4f-44bd-b89d-76001c7db1ca tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:18.433755 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-015f4c21-4c4f-44bd-b89d-76001c7db1ca tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:18.434338 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-015f4c21-4c4f-44bd-b89d-76001c7db1ca tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:18.435010 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-015f4c21-4c4f-44bd-b89d-76001c7db1ca tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:18.435802 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-015f4c21-4c4f-44bd-b89d-76001c7db1ca tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:18.436377 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-015f4c21-4c4f-44bd-b89d-76001c7db1ca tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:18.436885 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-015f4c21-4c4f-44bd-b89d-76001c7db1ca tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:18.596904 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8052d6af-56b9-48cd-bf05-a281750754ae tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:18.606087 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8052d6af-56b9-48cd-bf05-a281750754ae tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1358 microversion: 2.1 time: 0.222077 Sep 11 01:01:18.609322 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-015f4c21-4c4f-44bd-b89d-76001c7db1ca tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:18.613254 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 352/696] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:18 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:18.618223 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-015f4c21-4c4f-44bd-b89d-76001c7db1ca tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:18.619932 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-015f4c21-4c4f-44bd-b89d-76001c7db1ca tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:18.621328 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-015f4c21-4c4f-44bd-b89d-76001c7db1ca tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1741 microversion: 2.20 time: 0.201184 Sep 11 01:01:18.622534 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 345/697] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:18 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:19.640664 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c81c12cf-a757-4134-a836-bb1ecb351a25 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:19.643169 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c81c12cf-a757-4134-a836-bb1ecb351a25 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:19.647984 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-496c5abf-1288-409b-8b1a-4baa8abc393b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:19.648844 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-496c5abf-1288-409b-8b1a-4baa8abc393b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:19.658771 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-496c5abf-1288-409b-8b1a-4baa8abc393b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:19.659300 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-496c5abf-1288-409b-8b1a-4baa8abc393b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:19.659743 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-496c5abf-1288-409b-8b1a-4baa8abc393b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:19.660471 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-496c5abf-1288-409b-8b1a-4baa8abc393b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:19.660921 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-496c5abf-1288-409b-8b1a-4baa8abc393b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:19.661403 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-496c5abf-1288-409b-8b1a-4baa8abc393b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:19.665702 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c81c12cf-a757-4134-a836-bb1ecb351a25 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:19.667461 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c81c12cf-a757-4134-a836-bb1ecb351a25 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:19.670749 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c81c12cf-a757-4134-a836-bb1ecb351a25 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:19.671850 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c81c12cf-a757-4134-a836-bb1ecb351a25 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:19.672321 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c81c12cf-a757-4134-a836-bb1ecb351a25 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:19.673082 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c81c12cf-a757-4134-a836-bb1ecb351a25 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:19.974989 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-496c5abf-1288-409b-8b1a-4baa8abc393b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:19.988491 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-496c5abf-1288-409b-8b1a-4baa8abc393b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:19.990198 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-496c5abf-1288-409b-8b1a-4baa8abc393b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:19.992615 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-496c5abf-1288-409b-8b1a-4baa8abc393b tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1736 microversion: 2.20 time: 0.349127 Sep 11 01:01:19.993768 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 346/698] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:19 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1736 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:20.021707 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c81c12cf-a757-4134-a836-bb1ecb351a25 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:20.034344 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c81c12cf-a757-4134-a836-bb1ecb351a25 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1358 microversion: 2.1 time: 0.400962 Sep 11 01:01:20.048411 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 353/699] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:19 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1358 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:20.193073 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-43a3cdb4-c10b-43c6-a86c-e8ca54ac8462 req-65d40445-24e4-4b6f-b40c-d0f0b2b4c74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff12074-d8b0-4beb-9ddb-6e617f654908", "name": "network-vif-plugged", "status": "completed", "tag": "e1f950b8-4e34-4132-8dba-e46621d7902f"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:20.209609 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-43a3cdb4-c10b-43c6-a86c-e8ca54ac8462 req-65d40445-24e4-4b6f-b40c-d0f0b2b4c74f service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:20.210533 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-43a3cdb4-c10b-43c6-a86c-e8ca54ac8462 req-65d40445-24e4-4b6f-b40c-d0f0b2b4c74f service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:20.215207 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-43a3cdb4-c10b-43c6-a86c-e8ca54ac8462 req-65d40445-24e4-4b6f-b40c-d0f0b2b4c74f service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:20.237460 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-43a3cdb4-c10b-43c6-a86c-e8ca54ac8462 req-65d40445-24e4-4b6f-b40c-d0f0b2b4c74f service nova] Creating event network-vif-plugged:e1f950b8-4e34-4132-8dba-e46621d7902f for instance bff12074-d8b0-4beb-9ddb-6e617f654908 on hv-cinder-maste Sep 11 01:01:20.245523 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-43a3cdb4-c10b-43c6-a86c-e8ca54ac8462 req-65d40445-24e4-4b6f-b40c-d0f0b2b4c74f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055783 Sep 11 01:01:20.246794 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 347/700] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:21.022444 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0b2c4178-48cc-4362-a7ef-6532c733b329 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:21.023211 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-0b2c4178-48cc-4362-a7ef-6532c733b329 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:21.030812 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0b2c4178-48cc-4362-a7ef-6532c733b329 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:21.031342 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0b2c4178-48cc-4362-a7ef-6532c733b329 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:21.031775 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0b2c4178-48cc-4362-a7ef-6532c733b329 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:21.032473 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0b2c4178-48cc-4362-a7ef-6532c733b329 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:21.038801 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0b2c4178-48cc-4362-a7ef-6532c733b329 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:21.039114 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0b2c4178-48cc-4362-a7ef-6532c733b329 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:21.063872 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-dafcb2f9-e30a-4b9d-b56a-7566e812e2f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:21.065541 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-dafcb2f9-e30a-4b9d-b56a-7566e812e2f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:21.079991 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dafcb2f9-e30a-4b9d-b56a-7566e812e2f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:21.082284 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dafcb2f9-e30a-4b9d-b56a-7566e812e2f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:21.083208 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dafcb2f9-e30a-4b9d-b56a-7566e812e2f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:21.086141 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dafcb2f9-e30a-4b9d-b56a-7566e812e2f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:21.086758 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dafcb2f9-e30a-4b9d-b56a-7566e812e2f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:21.087452 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dafcb2f9-e30a-4b9d-b56a-7566e812e2f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:21.277221 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0b2c4178-48cc-4362-a7ef-6532c733b329 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:21.296365 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0b2c4178-48cc-4362-a7ef-6532c733b329 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:21.299232 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0b2c4178-48cc-4362-a7ef-6532c733b329 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:21.302032 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0b2c4178-48cc-4362-a7ef-6532c733b329 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1736 microversion: 2.20 time: 0.283452 Sep 11 01:01:21.302843 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 354/701] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:21 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1736 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:21.335259 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-dafcb2f9-e30a-4b9d-b56a-7566e812e2f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:21.351711 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-dafcb2f9-e30a-4b9d-b56a-7566e812e2f7 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1358 microversion: 2.1 time: 0.292030 Sep 11 01:01:21.352357 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 348/702] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:21 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:21.561281 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-603e2460-2f3f-486a-b5bb-2b1ccbfaca75 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:21.562241 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-603e2460-2f3f-486a-b5bb-2b1ccbfaca75 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:21.569055 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-603e2460-2f3f-486a-b5bb-2b1ccbfaca75 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:21.569845 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-603e2460-2f3f-486a-b5bb-2b1ccbfaca75 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:21.570440 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-603e2460-2f3f-486a-b5bb-2b1ccbfaca75 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:21.571112 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-603e2460-2f3f-486a-b5bb-2b1ccbfaca75 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:21.571718 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-603e2460-2f3f-486a-b5bb-2b1ccbfaca75 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:21.572113 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-603e2460-2f3f-486a-b5bb-2b1ccbfaca75 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:21.601759 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-603e2460-2f3f-486a-b5bb-2b1ccbfaca75 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/ips" status: 200 len: 146 microversion: 2.1 time: 0.278144 Sep 11 01:01:21.602575 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 355/703] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Sep 11 01:01:21 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/ips => generated 146 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:01:22.266461 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-f59bd895-2b5b-4db0-a945-fbf97bffd23e req-a2302cae-7f8c-4d0d-8213-bd0035703678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65943bbe-32ae-424f-8341-ddf47713744f", "name": "network-vif-plugged", "status": "completed", "tag": "b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:22.278459 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-f59bd895-2b5b-4db0-a945-fbf97bffd23e req-a2302cae-7f8c-4d0d-8213-bd0035703678 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:22.280695 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-f59bd895-2b5b-4db0-a945-fbf97bffd23e req-a2302cae-7f8c-4d0d-8213-bd0035703678 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:22.281215 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-f59bd895-2b5b-4db0-a945-fbf97bffd23e req-a2302cae-7f8c-4d0d-8213-bd0035703678 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:22.294410 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-f59bd895-2b5b-4db0-a945-fbf97bffd23e req-a2302cae-7f8c-4d0d-8213-bd0035703678 service nova] Creating event network-vif-plugged:b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71 for instance 65943bbe-32ae-424f-8341-ddf47713744f on hv-cinder-maste Sep 11 01:01:22.300889 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-f59bd895-2b5b-4db0-a945-fbf97bffd23e req-a2302cae-7f8c-4d0d-8213-bd0035703678 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038164 Sep 11 01:01:22.302056 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 349/704] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:22.331302 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-7aa10b8a-f08f-43fc-b724-c5671e96f629 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:22.332161 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-7aa10b8a-f08f-43fc-b724-c5671e96f629 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:22.339588 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7aa10b8a-f08f-43fc-b724-c5671e96f629 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:22.340177 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7aa10b8a-f08f-43fc-b724-c5671e96f629 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:22.340693 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7aa10b8a-f08f-43fc-b724-c5671e96f629 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:22.341470 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7aa10b8a-f08f-43fc-b724-c5671e96f629 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:22.342021 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7aa10b8a-f08f-43fc-b724-c5671e96f629 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:22.342674 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7aa10b8a-f08f-43fc-b724-c5671e96f629 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:22.386078 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b2c95e73-2629-4cb7-8282-0654113d34a3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:22.387082 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b2c95e73-2629-4cb7-8282-0654113d34a3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:22.410158 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2c95e73-2629-4cb7-8282-0654113d34a3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:22.411342 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2c95e73-2629-4cb7-8282-0654113d34a3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:22.412005 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2c95e73-2629-4cb7-8282-0654113d34a3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:22.417489 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2c95e73-2629-4cb7-8282-0654113d34a3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:22.419445 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2c95e73-2629-4cb7-8282-0654113d34a3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:22.422195 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2c95e73-2629-4cb7-8282-0654113d34a3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:22.609711 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-7aa10b8a-f08f-43fc-b724-c5671e96f629 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:22.624181 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-7aa10b8a-f08f-43fc-b724-c5671e96f629 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:22.632985 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-7aa10b8a-f08f-43fc-b724-c5671e96f629 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:22.634933 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-7aa10b8a-f08f-43fc-b724-c5671e96f629 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1736 microversion: 2.20 time: 0.307414 Sep 11 01:01:22.649687 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 356/705] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:22 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1736 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:22.696314 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b2c95e73-2629-4cb7-8282-0654113d34a3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:22.705736 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b2c95e73-2629-4cb7-8282-0654113d34a3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1358 microversion: 2.1 time: 0.325669 Sep 11 01:01:22.710998 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 350/706] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:22 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1358 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:23.058750 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-257f69d2-9295-44e1-bbcc-03b3ea693e5c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8d0b56a-c7ef-4315-b970-07565b58c29e"}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:23.061243 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-257f69d2-9295-44e1-bbcc-03b3ea693e5c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:23.067858 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-257f69d2-9295-44e1-bbcc-03b3ea693e5c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:23.068360 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-257f69d2-9295-44e1-bbcc-03b3ea693e5c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:23.069418 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-257f69d2-9295-44e1-bbcc-03b3ea693e5c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:23.069529 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-257f69d2-9295-44e1-bbcc-03b3ea693e5c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:23.069899 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-257f69d2-9295-44e1-bbcc-03b3ea693e5c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:23.070317 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-257f69d2-9295-44e1-bbcc-03b3ea693e5c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:23.094830 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=100 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:23.666126 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4db812cb-c338-48bb-abef-6ce589289745 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:23.667111 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4db812cb-c338-48bb-abef-6ce589289745 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:23.674714 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4db812cb-c338-48bb-abef-6ce589289745 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:23.675547 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4db812cb-c338-48bb-abef-6ce589289745 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:23.676247 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4db812cb-c338-48bb-abef-6ce589289745 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:23.677198 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4db812cb-c338-48bb-abef-6ce589289745 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:23.677841 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4db812cb-c338-48bb-abef-6ce589289745 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:23.678639 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4db812cb-c338-48bb-abef-6ce589289745 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:23.721534 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-257f69d2-9295-44e1-bbcc-03b3ea693e5c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "POST /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.667043 Sep 11 01:01:23.723218 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 357/707] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Sep 11 01:01:23 2022] POST /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments => generated 194 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:23.729599 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e19caf92-40f9-4c23-b726-90bb63d0d094 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:23.730407 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-e19caf92-40f9-4c23-b726-90bb63d0d094 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:23.755312 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e19caf92-40f9-4c23-b726-90bb63d0d094 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:23.756054 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e19caf92-40f9-4c23-b726-90bb63d0d094 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:23.756612 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e19caf92-40f9-4c23-b726-90bb63d0d094 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:23.757406 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e19caf92-40f9-4c23-b726-90bb63d0d094 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:23.758003 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e19caf92-40f9-4c23-b726-90bb63d0d094 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:23.758443 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e19caf92-40f9-4c23-b726-90bb63d0d094 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:23.916259 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4db812cb-c338-48bb-abef-6ce589289745 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:23.925365 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4db812cb-c338-48bb-abef-6ce589289745 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:23.927161 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4db812cb-c338-48bb-abef-6ce589289745 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:23.928601 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4db812cb-c338-48bb-abef-6ce589289745 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1736 microversion: 2.20 time: 0.267509 Sep 11 01:01:23.940205 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 351/708] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:23 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1736 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:23.952358 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-e19caf92-40f9-4c23-b726-90bb63d0d094 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:23.961916 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-e19caf92-40f9-4c23-b726-90bb63d0d094 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1358 microversion: 2.1 time: 0.236614 Sep 11 01:01:23.962719 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 358/709] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:23 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:01:24.958282 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0f6c9985-190e-416d-b1b7-825d01f8fb4a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:24.959685 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0f6c9985-190e-416d-b1b7-825d01f8fb4a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:24.966537 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f6c9985-190e-416d-b1b7-825d01f8fb4a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:24.967141 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f6c9985-190e-416d-b1b7-825d01f8fb4a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:24.967594 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f6c9985-190e-416d-b1b7-825d01f8fb4a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:24.968319 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f6c9985-190e-416d-b1b7-825d01f8fb4a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:24.968751 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f6c9985-190e-416d-b1b7-825d01f8fb4a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:24.969168 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f6c9985-190e-416d-b1b7-825d01f8fb4a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:24.991155 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-1b94c6fb-0585-4675-9760-f312c7063ddf tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:24.993200 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-1b94c6fb-0585-4675-9760-f312c7063ddf tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:25.004807 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1b94c6fb-0585-4675-9760-f312c7063ddf tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:25.007205 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1b94c6fb-0585-4675-9760-f312c7063ddf tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:25.008097 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1b94c6fb-0585-4675-9760-f312c7063ddf tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:25.012193 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1b94c6fb-0585-4675-9760-f312c7063ddf tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:25.012745 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1b94c6fb-0585-4675-9760-f312c7063ddf tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:25.013350 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1b94c6fb-0585-4675-9760-f312c7063ddf tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:25.222482 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0f6c9985-190e-416d-b1b7-825d01f8fb4a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:25.228018 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1b94c6fb-0585-4675-9760-f312c7063ddf tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:25.232988 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0f6c9985-190e-416d-b1b7-825d01f8fb4a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:25.234660 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-0f6c9985-190e-416d-b1b7-825d01f8fb4a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:25.236400 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0f6c9985-190e-416d-b1b7-825d01f8fb4a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1736 microversion: 2.20 time: 0.282459 Sep 11 01:01:25.236862 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-1b94c6fb-0585-4675-9760-f312c7063ddf tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1548 microversion: 2.1 time: 0.255288 Sep 11 01:01:25.238858 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 359/710] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:24 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1548 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:25.260518 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 352/711] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:24 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1736 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:25.295953 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-904946a5-bebb-4f1f-9bc4-3e41956621d4 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:25.296859 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-904946a5-bebb-4f1f-9bc4-3e41956621d4 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:25.307859 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-904946a5-bebb-4f1f-9bc4-3e41956621d4 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:25.308586 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-904946a5-bebb-4f1f-9bc4-3e41956621d4 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:25.309190 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-904946a5-bebb-4f1f-9bc4-3e41956621d4 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:25.310198 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-904946a5-bebb-4f1f-9bc4-3e41956621d4 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:25.310800 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-904946a5-bebb-4f1f-9bc4-3e41956621d4 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:25.311591 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-904946a5-bebb-4f1f-9bc4-3e41956621d4 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:25.470343 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-904946a5-bebb-4f1f-9bc4-3e41956621d4 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:25.479018 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-904946a5-bebb-4f1f-9bc4-3e41956621d4 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1548 microversion: 2.1 time: 0.188812 Sep 11 01:01:25.480783 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 360/712] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:25 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1548 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:25.503425 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f1e0ce17-1c8a-472d-882a-669221b694be tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:25.510801 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f1e0ce17-1c8a-472d-882a-669221b694be tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:25.511842 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f1e0ce17-1c8a-472d-882a-669221b694be tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Searching by: {'deleted': False, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d'} {{(pid=120496) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 11 01:01:25.519848 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1e0ce17-1c8a-472d-882a-669221b694be tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:25.520957 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1e0ce17-1c8a-472d-882a-669221b694be tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:25.521598 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1e0ce17-1c8a-472d-882a-669221b694be tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:25.523081 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1e0ce17-1c8a-472d-882a-669221b694be tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:25.524018 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1e0ce17-1c8a-472d-882a-669221b694be tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:25.524614 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1e0ce17-1c8a-472d-882a-669221b694be tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:25.636620 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.multi_cell_list [None req-f1e0ce17-1c8a-472d-882a-669221b694be tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120496) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 11 01:01:25.790132 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f1e0ce17-1c8a-472d-882a-669221b694be tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.291447 Sep 11 01:01:25.794275 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 353/713] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Sep 11 01:01:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:25.804012 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f9308f6d-1c35-4e4b-aa57-b2bfd42cdb1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:25.804899 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f9308f6d-1c35-4e4b-aa57-b2bfd42cdb1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:25.812918 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f9308f6d-1c35-4e4b-aa57-b2bfd42cdb1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:25.813858 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f9308f6d-1c35-4e4b-aa57-b2bfd42cdb1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:25.814504 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f9308f6d-1c35-4e4b-aa57-b2bfd42cdb1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:25.815678 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f9308f6d-1c35-4e4b-aa57-b2bfd42cdb1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:25.816645 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f9308f6d-1c35-4e4b-aa57-b2bfd42cdb1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:25.817231 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f9308f6d-1c35-4e4b-aa57-b2bfd42cdb1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:26.032482 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f9308f6d-1c35-4e4b-aa57-b2bfd42cdb1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:26.048740 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f9308f6d-1c35-4e4b-aa57-b2bfd42cdb1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1548 microversion: 2.1 time: 0.249771 Sep 11 01:01:26.049319 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 361/714] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:25 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1548 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:26.106489 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-735e088d-12a2-4353-8631-d2b4edcbd28e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:26.110298 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-735e088d-12a2-4353-8631-d2b4edcbd28e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:26.128614 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-735e088d-12a2-4353-8631-d2b4edcbd28e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:26.129109 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-735e088d-12a2-4353-8631-d2b4edcbd28e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:26.129547 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-735e088d-12a2-4353-8631-d2b4edcbd28e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:26.130275 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-735e088d-12a2-4353-8631-d2b4edcbd28e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:26.130758 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-735e088d-12a2-4353-8631-d2b4edcbd28e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:26.131447 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-735e088d-12a2-4353-8631-d2b4edcbd28e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:26.186712 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-735e088d-12a2-4353-8631-d2b4edcbd28e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085455 Sep 11 01:01:26.187325 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 354/715] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:01:26 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:26.210452 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-07468ed2-18e7-4be5-b829-4c09e39f06f8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:26.210949 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-07468ed2-18e7-4be5-b829-4c09e39f06f8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:26.221717 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-07468ed2-18e7-4be5-b829-4c09e39f06f8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:26.222546 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-07468ed2-18e7-4be5-b829-4c09e39f06f8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:26.224227 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-07468ed2-18e7-4be5-b829-4c09e39f06f8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:26.225185 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-07468ed2-18e7-4be5-b829-4c09e39f06f8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:26.225804 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-07468ed2-18e7-4be5-b829-4c09e39f06f8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:26.226405 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-07468ed2-18e7-4be5-b829-4c09e39f06f8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:26.272416 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-07468ed2-18e7-4be5-b829-4c09e39f06f8 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments/a8d0b56a-c7ef-4315-b970-07565b58c29e" status: 200 len: 194 microversion: 2.1 time: 0.065959 Sep 11 01:01:26.278265 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 362/716] 10.222.0.23 () {58 vars in 1413 bytes} [Sun Sep 11 01:01:26 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments/a8d0b56a-c7ef-4315-b970-07565b58c29e => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:26.313949 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-577d415e-39e4-46f3-8f05-6c6cec2279b9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:26.317362 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-577d415e-39e4-46f3-8f05-6c6cec2279b9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:26.333160 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-577d415e-39e4-46f3-8f05-6c6cec2279b9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:26.334283 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-577d415e-39e4-46f3-8f05-6c6cec2279b9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:26.337130 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-577d415e-39e4-46f3-8f05-6c6cec2279b9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:26.340850 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-577d415e-39e4-46f3-8f05-6c6cec2279b9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:26.341566 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-577d415e-39e4-46f3-8f05-6c6cec2279b9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:26.343115 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-577d415e-39e4-46f3-8f05-6c6cec2279b9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:26.599944 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-577d415e-39e4-46f3-8f05-6c6cec2279b9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:26.611622 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-577d415e-39e4-46f3-8f05-6c6cec2279b9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:26.614230 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-577d415e-39e4-46f3-8f05-6c6cec2279b9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:26.615946 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-577d415e-39e4-46f3-8f05-6c6cec2279b9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1736 microversion: 2.20 time: 0.322418 Sep 11 01:01:26.631209 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 355/717] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:26 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1736 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:27.648460 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-cc56c365-9f8a-4adc-ba24-5033a58c4205 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:27.649788 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-cc56c365-9f8a-4adc-ba24-5033a58c4205 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:27.656928 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cc56c365-9f8a-4adc-ba24-5033a58c4205 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:27.658366 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cc56c365-9f8a-4adc-ba24-5033a58c4205 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:27.658964 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cc56c365-9f8a-4adc-ba24-5033a58c4205 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:27.661303 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cc56c365-9f8a-4adc-ba24-5033a58c4205 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:27.661919 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cc56c365-9f8a-4adc-ba24-5033a58c4205 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:27.662495 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cc56c365-9f8a-4adc-ba24-5033a58c4205 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:27.868729 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-cc56c365-9f8a-4adc-ba24-5033a58c4205 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:27.881581 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-cc56c365-9f8a-4adc-ba24-5033a58c4205 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:27.884425 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-cc56c365-9f8a-4adc-ba24-5033a58c4205 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:27.886020 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-cc56c365-9f8a-4adc-ba24-5033a58c4205 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1736 microversion: 2.20 time: 0.242645 Sep 11 01:01:27.898552 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 363/718] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:27 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1736 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:27.925425 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fa7d9d4a-ce91-49ce-97c5-3737f54426f2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce8470b2-ab98-413c-a479-839ac7e91a30"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:27.930879 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-fa7d9d4a-ce91-49ce-97c5-3737f54426f2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:27.940349 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa7d9d4a-ce91-49ce-97c5-3737f54426f2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:27.950748 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa7d9d4a-ce91-49ce-97c5-3737f54426f2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:27.951442 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa7d9d4a-ce91-49ce-97c5-3737f54426f2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:27.952672 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa7d9d4a-ce91-49ce-97c5-3737f54426f2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:27.954257 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa7d9d4a-ce91-49ce-97c5-3737f54426f2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:27.954749 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa7d9d4a-ce91-49ce-97c5-3737f54426f2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:28.071142 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-40bc6e6f-c5cf-4644-a48f-1907fd6af809 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca2efa77-4eb8-4696-a4d9-9b9b39436891"}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:28.073740 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-40bc6e6f-c5cf-4644-a48f-1907fd6af809 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:28.088297 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-40bc6e6f-c5cf-4644-a48f-1907fd6af809 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:28.089599 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-40bc6e6f-c5cf-4644-a48f-1907fd6af809 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:28.090215 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-40bc6e6f-c5cf-4644-a48f-1907fd6af809 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:28.091086 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-40bc6e6f-c5cf-4644-a48f-1907fd6af809 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:28.091782 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-40bc6e6f-c5cf-4644-a48f-1907fd6af809 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:28.092421 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-40bc6e6f-c5cf-4644-a48f-1907fd6af809 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:28.400430 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-fa7d9d4a-ce91-49ce-97c5-3737f54426f2 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "POST /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478997 Sep 11 01:01:28.401610 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 356/719] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Sep 11 01:01:27 2022] POST /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments => generated 194 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:28.538583 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-40bc6e6f-c5cf-4644-a48f-1907fd6af809 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "POST /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.470838 Sep 11 01:01:28.540653 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 364/720] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Sep 11 01:01:28 2022] POST /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/os-volume_attachments => generated 194 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:01:28.921652 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6d4ff0f5-2ec9-47c3-87e0-3bc6bd91808a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:28.922350 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6d4ff0f5-2ec9-47c3-87e0-3bc6bd91808a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:28.929528 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d4ff0f5-2ec9-47c3-87e0-3bc6bd91808a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:28.930153 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d4ff0f5-2ec9-47c3-87e0-3bc6bd91808a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:28.930422 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d4ff0f5-2ec9-47c3-87e0-3bc6bd91808a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:28.931113 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d4ff0f5-2ec9-47c3-87e0-3bc6bd91808a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:28.934771 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d4ff0f5-2ec9-47c3-87e0-3bc6bd91808a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:28.937067 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d4ff0f5-2ec9-47c3-87e0-3bc6bd91808a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:29.355584 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6d4ff0f5-2ec9-47c3-87e0-3bc6bd91808a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:29.367231 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6d4ff0f5-2ec9-47c3-87e0-3bc6bd91808a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:29.368976 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6d4ff0f5-2ec9-47c3-87e0-3bc6bd91808a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:29.370570 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6d4ff0f5-2ec9-47c3-87e0-3bc6bd91808a tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1736 microversion: 2.20 time: 0.453815 Sep 11 01:01:29.387607 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 357/721] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:28 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1736 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:30.398139 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ffd42316-8820-4ff1-9133-7f62b8fc6dd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:30.398877 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ffd42316-8820-4ff1-9133-7f62b8fc6dd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:30.407964 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ffd42316-8820-4ff1-9133-7f62b8fc6dd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:30.408440 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ffd42316-8820-4ff1-9133-7f62b8fc6dd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:30.408871 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ffd42316-8820-4ff1-9133-7f62b8fc6dd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:30.409572 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ffd42316-8820-4ff1-9133-7f62b8fc6dd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:30.410020 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ffd42316-8820-4ff1-9133-7f62b8fc6dd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:30.410441 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ffd42316-8820-4ff1-9133-7f62b8fc6dd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:30.547232 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ffd42316-8820-4ff1-9133-7f62b8fc6dd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:30.556577 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ffd42316-8820-4ff1-9133-7f62b8fc6dd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:30.558118 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-ffd42316-8820-4ff1-9133-7f62b8fc6dd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:30.559378 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ffd42316-8820-4ff1-9133-7f62b8fc6dd3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1736 microversion: 2.20 time: 0.166614 Sep 11 01:01:30.559963 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 365/722] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:30 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:31.592033 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8adac4d4-2f65-4550-9e78-8973567048c4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:31.592689 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8adac4d4-2f65-4550-9e78-8973567048c4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:31.599483 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8adac4d4-2f65-4550-9e78-8973567048c4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:31.599967 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8adac4d4-2f65-4550-9e78-8973567048c4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:31.600394 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8adac4d4-2f65-4550-9e78-8973567048c4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:31.601061 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8adac4d4-2f65-4550-9e78-8973567048c4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:31.601602 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8adac4d4-2f65-4550-9e78-8973567048c4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:31.601947 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8adac4d4-2f65-4550-9e78-8973567048c4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:31.758733 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a9930423-fdb6-4cc2-ae6b-03571b7538f1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:31.760978 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a9930423-fdb6-4cc2-ae6b-03571b7538f1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:31.767965 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a9930423-fdb6-4cc2-ae6b-03571b7538f1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:31.768454 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a9930423-fdb6-4cc2-ae6b-03571b7538f1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:31.768864 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a9930423-fdb6-4cc2-ae6b-03571b7538f1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:31.769547 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a9930423-fdb6-4cc2-ae6b-03571b7538f1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:31.769994 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a9930423-fdb6-4cc2-ae6b-03571b7538f1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:31.770389 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a9930423-fdb6-4cc2-ae6b-03571b7538f1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:31.806352 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8adac4d4-2f65-4550-9e78-8973567048c4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:31.806664 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a9930423-fdb6-4cc2-ae6b-03571b7538f1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052053 Sep 11 01:01:31.807465 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 366/723] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:01:31 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:01:31.815496 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8adac4d4-2f65-4550-9e78-8973567048c4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:31.816935 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8adac4d4-2f65-4550-9e78-8973567048c4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:31.818096 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8adac4d4-2f65-4550-9e78-8973567048c4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1718 microversion: 2.20 time: 0.230611 Sep 11 01:01:31.818638 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 358/724] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:31 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1718 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:31.948704 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-87d6ad28-b9c3-4663-ba50-57bf39716b89 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:31.949193 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-87d6ad28-b9c3-4663-ba50-57bf39716b89 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:31.955945 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-87d6ad28-b9c3-4663-ba50-57bf39716b89 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:31.956703 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-87d6ad28-b9c3-4663-ba50-57bf39716b89 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:31.957376 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-87d6ad28-b9c3-4663-ba50-57bf39716b89 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:31.958754 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-87d6ad28-b9c3-4663-ba50-57bf39716b89 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:31.959432 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-87d6ad28-b9c3-4663-ba50-57bf39716b89 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:31.959927 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-87d6ad28-b9c3-4663-ba50-57bf39716b89 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:31.995790 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-87d6ad28-b9c3-4663-ba50-57bf39716b89 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments/a8d0b56a-c7ef-4315-b970-07565b58c29e" status: 200 len: 194 microversion: 2.1 time: 0.051420 Sep 11 01:01:31.996418 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 367/725] 10.222.0.23 () {58 vars in 1413 bytes} [Sun Sep 11 01:01:31 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments/a8d0b56a-c7ef-4315-b970-07565b58c29e => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:32.006948 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-355c5e54-269c-45aa-b5b6-17501d1c9565 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:32.007725 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-355c5e54-269c-45aa-b5b6-17501d1c9565 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:32.013667 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-355c5e54-269c-45aa-b5b6-17501d1c9565 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:32.014143 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-355c5e54-269c-45aa-b5b6-17501d1c9565 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:32.014567 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-355c5e54-269c-45aa-b5b6-17501d1c9565 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:32.015489 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-355c5e54-269c-45aa-b5b6-17501d1c9565 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:32.016137 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-355c5e54-269c-45aa-b5b6-17501d1c9565 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:32.016615 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-355c5e54-269c-45aa-b5b6-17501d1c9565 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:32.040640 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c2d3fdb9-1bbc-4c5c-93b2-72c72a1d2b18 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:32.041291 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c2d3fdb9-1bbc-4c5c-93b2-72c72a1d2b18 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:32.047469 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2d3fdb9-1bbc-4c5c-93b2-72c72a1d2b18 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:32.047953 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2d3fdb9-1bbc-4c5c-93b2-72c72a1d2b18 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:32.048383 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2d3fdb9-1bbc-4c5c-93b2-72c72a1d2b18 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:32.049076 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2d3fdb9-1bbc-4c5c-93b2-72c72a1d2b18 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:32.049522 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2d3fdb9-1bbc-4c5c-93b2-72c72a1d2b18 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:32.049940 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c2d3fdb9-1bbc-4c5c-93b2-72c72a1d2b18 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:32.109908 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-355c5e54-269c-45aa-b5b6-17501d1c9565 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lazy-loading 'services' on Instance uuid bb3eb557-558f-456d-83b2-23769926f3ca {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:01:32.113624 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:32.188308 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-355c5e54-269c-45aa-b5b6-17501d1c9565 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments/a8d0b56a-c7ef-4315-b970-07565b58c29e" status: 202 len: 0 microversion: 2.1 time: 0.185033 Sep 11 01:01:32.189592 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 359/726] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Sep 11 01:01:32 2022] DELETE /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments/a8d0b56a-c7ef-4315-b970-07565b58c29e => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:01:32.327711 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c2d3fdb9-1bbc-4c5c-93b2-72c72a1d2b18 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:32.350995 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c2d3fdb9-1bbc-4c5c-93b2-72c72a1d2b18 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1594 microversion: 2.1 time: 0.314682 Sep 11 01:01:32.351841 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 368/727] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:32 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1594 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:01:32.844758 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a16dc9f2-876f-474e-a492-ecd0ffa5aea9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:32.845452 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a16dc9f2-876f-474e-a492-ecd0ffa5aea9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:32.852199 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a16dc9f2-876f-474e-a492-ecd0ffa5aea9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:32.852675 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a16dc9f2-876f-474e-a492-ecd0ffa5aea9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:32.853210 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a16dc9f2-876f-474e-a492-ecd0ffa5aea9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:32.854162 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a16dc9f2-876f-474e-a492-ecd0ffa5aea9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:32.854607 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a16dc9f2-876f-474e-a492-ecd0ffa5aea9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:32.855020 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a16dc9f2-876f-474e-a492-ecd0ffa5aea9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:33.027024 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a16dc9f2-876f-474e-a492-ecd0ffa5aea9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:33.035716 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a16dc9f2-876f-474e-a492-ecd0ffa5aea9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:33.037130 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a16dc9f2-876f-474e-a492-ecd0ffa5aea9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:33.038647 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a16dc9f2-876f-474e-a492-ecd0ffa5aea9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1718 microversion: 2.20 time: 0.198452 Sep 11 01:01:33.039484 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 360/728] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:32 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1718 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:33.809317 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-46b47964-8563-445e-90f9-c7f863c356b8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:33.810799 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-46b47964-8563-445e-90f9-c7f863c356b8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:33.817934 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-46b47964-8563-445e-90f9-c7f863c356b8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:33.819400 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-46b47964-8563-445e-90f9-c7f863c356b8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:33.820105 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-46b47964-8563-445e-90f9-c7f863c356b8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:33.821052 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-46b47964-8563-445e-90f9-c7f863c356b8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:33.821701 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-46b47964-8563-445e-90f9-c7f863c356b8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:33.822327 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-46b47964-8563-445e-90f9-c7f863c356b8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:33.847629 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-46b47964-8563-445e-90f9-c7f863c356b8 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/ips" status: 200 len: 151 microversion: 2.1 time: 0.241929 Sep 11 01:01:33.848297 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 369/729] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Sep 11 01:01:33 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/ips => generated 151 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:34.063862 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-54d4a815-882d-4404-8b25-4a339a0d0da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:34.065167 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-54d4a815-882d-4404-8b25-4a339a0d0da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:34.073773 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54d4a815-882d-4404-8b25-4a339a0d0da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:34.074792 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54d4a815-882d-4404-8b25-4a339a0d0da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:34.076004 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54d4a815-882d-4404-8b25-4a339a0d0da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:34.076793 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54d4a815-882d-4404-8b25-4a339a0d0da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:34.077443 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54d4a815-882d-4404-8b25-4a339a0d0da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:34.078128 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-54d4a815-882d-4404-8b25-4a339a0d0da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:34.353597 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-54d4a815-882d-4404-8b25-4a339a0d0da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:34.367969 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-54d4a815-882d-4404-8b25-4a339a0d0da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:34.375284 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-54d4a815-882d-4404-8b25-4a339a0d0da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:34.380538 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-54d4a815-882d-4404-8b25-4a339a0d0da9 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1718 microversion: 2.20 time: 0.320442 Sep 11 01:01:34.381672 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 361/730] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:34 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1718 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:34.528744 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-addff8e2-cf8f-4cec-82a3-e21314e2a332 req-c9aaab67-d665-4ef0-9b62-43621cb96390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65943bbe-32ae-424f-8341-ddf47713744f", "tag": "b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:34.557443 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-addff8e2-cf8f-4cec-82a3-e21314e2a332 req-c9aaab67-d665-4ef0-9b62-43621cb96390 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:34.557916 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-addff8e2-cf8f-4cec-82a3-e21314e2a332 req-c9aaab67-d665-4ef0-9b62-43621cb96390 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:34.558333 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-addff8e2-cf8f-4cec-82a3-e21314e2a332 req-c9aaab67-d665-4ef0-9b62-43621cb96390 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:34.576669 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-addff8e2-cf8f-4cec-82a3-e21314e2a332 req-c9aaab67-d665-4ef0-9b62-43621cb96390 service nova] Creating event network-changed:b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71 for instance 65943bbe-32ae-424f-8341-ddf47713744f on hv-cinder-maste Sep 11 01:01:34.584304 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-addff8e2-cf8f-4cec-82a3-e21314e2a332 req-c9aaab67-d665-4ef0-9b62-43621cb96390 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256384 Sep 11 01:01:34.585649 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 370/731] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:01:35.285495 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c6ad1ba8-c951-43b0-8bcd-323d4fe78e40 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f371037-780b-4f12-b0b3-57662e7c2941"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:35.288711 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c6ad1ba8-c951-43b0-8bcd-323d4fe78e40 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:35.303998 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6ad1ba8-c951-43b0-8bcd-323d4fe78e40 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:35.312557 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6ad1ba8-c951-43b0-8bcd-323d4fe78e40 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:35.313082 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6ad1ba8-c951-43b0-8bcd-323d4fe78e40 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:35.314039 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6ad1ba8-c951-43b0-8bcd-323d4fe78e40 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:35.314522 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6ad1ba8-c951-43b0-8bcd-323d4fe78e40 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:35.314926 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6ad1ba8-c951-43b0-8bcd-323d4fe78e40 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:35.414159 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e58c0402-96c1-47cc-ac12-455c17cff01f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:35.415047 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-e58c0402-96c1-47cc-ac12-455c17cff01f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:35.425434 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e58c0402-96c1-47cc-ac12-455c17cff01f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:35.425934 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e58c0402-96c1-47cc-ac12-455c17cff01f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:35.426363 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e58c0402-96c1-47cc-ac12-455c17cff01f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:35.428303 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e58c0402-96c1-47cc-ac12-455c17cff01f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:35.428791 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e58c0402-96c1-47cc-ac12-455c17cff01f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:35.432907 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e58c0402-96c1-47cc-ac12-455c17cff01f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:35.586774 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:35.764923 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c6ad1ba8-c951-43b0-8bcd-323d4fe78e40 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "POST /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486004 Sep 11 01:01:35.765888 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 362/732] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Sep 11 01:01:35 2022] POST /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/os-volume_attachments => generated 194 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:35.779102 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-137cf543-bc17-452c-8e48-2d01155265b0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:35.780686 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-137cf543-bc17-452c-8e48-2d01155265b0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:35.795136 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-137cf543-bc17-452c-8e48-2d01155265b0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:35.795674 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-137cf543-bc17-452c-8e48-2d01155265b0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:35.796152 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-137cf543-bc17-452c-8e48-2d01155265b0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:35.796837 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-137cf543-bc17-452c-8e48-2d01155265b0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:35.797285 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-137cf543-bc17-452c-8e48-2d01155265b0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:35.803877 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-137cf543-bc17-452c-8e48-2d01155265b0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:35.877117 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-137cf543-bc17-452c-8e48-2d01155265b0 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments/ce8470b2-ab98-413c-a479-839ac7e91a30" status: 200 len: 194 microversion: 2.1 time: 0.106621 Sep 11 01:01:35.879169 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 363/733] 10.222.0.23 () {58 vars in 1413 bytes} [Sun Sep 11 01:01:35 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments/ce8470b2-ab98-413c-a479-839ac7e91a30 => generated 194 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:35.907746 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5d59cc90-f09b-4d9a-b3f1-49623e7d690c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:35.911885 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5d59cc90-f09b-4d9a-b3f1-49623e7d690c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:35.937228 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5d59cc90-f09b-4d9a-b3f1-49623e7d690c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:35.937228 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5d59cc90-f09b-4d9a-b3f1-49623e7d690c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:35.937228 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5d59cc90-f09b-4d9a-b3f1-49623e7d690c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:35.937228 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5d59cc90-f09b-4d9a-b3f1-49623e7d690c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:35.937635 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5d59cc90-f09b-4d9a-b3f1-49623e7d690c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:35.954006 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5d59cc90-f09b-4d9a-b3f1-49623e7d690c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:36.034739 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-e58c0402-96c1-47cc-ac12-455c17cff01f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:36.048589 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-e58c0402-96c1-47cc-ac12-455c17cff01f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:36.061698 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-e58c0402-96c1-47cc-ac12-455c17cff01f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:36.062995 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-e58c0402-96c1-47cc-ac12-455c17cff01f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1661 microversion: 2.20 time: 0.654189 Sep 11 01:01:36.063611 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 371/734] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:35 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1661 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:36.091906 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e1898005-388c-4dca-b11f-05b28756adb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fa6a1f7-b67b-4aeb-b4ef-c1a49e72b68b"}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:36.094933 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-e1898005-388c-4dca-b11f-05b28756adb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:36.102438 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e1898005-388c-4dca-b11f-05b28756adb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:36.103004 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e1898005-388c-4dca-b11f-05b28756adb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:36.103643 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e1898005-388c-4dca-b11f-05b28756adb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:36.104542 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e1898005-388c-4dca-b11f-05b28756adb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:36.104998 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e1898005-388c-4dca-b11f-05b28756adb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:36.105470 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e1898005-388c-4dca-b11f-05b28756adb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:36.134678 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:36.143498 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-5d59cc90-f09b-4d9a-b3f1-49623e7d690c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lazy-loading 'services' on Instance uuid bb3eb557-558f-456d-83b2-23769926f3ca {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:01:36.301920 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5d59cc90-f09b-4d9a-b3f1-49623e7d690c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments/ce8470b2-ab98-413c-a479-839ac7e91a30" status: 202 len: 0 microversion: 2.1 time: 0.404156 Sep 11 01:01:36.306548 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 364/735] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Sep 11 01:01:35 2022] DELETE /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments/ce8470b2-ab98-413c-a479-839ac7e91a30 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:01:36.495845 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-b60d59ea-c58e-45a2-bc0a-db188c63576d req-f326a8ef-bc01-4675-b50c-4c4e9537f524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff12074-d8b0-4beb-9ddb-6e617f654908", "name": "network-vif-unplugged", "status": "completed", "tag": "e1f950b8-4e34-4132-8dba-e46621d7902f"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:36.506399 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-b60d59ea-c58e-45a2-bc0a-db188c63576d req-f326a8ef-bc01-4675-b50c-4c4e9537f524 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:36.508087 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-b60d59ea-c58e-45a2-bc0a-db188c63576d req-f326a8ef-bc01-4675-b50c-4c4e9537f524 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:36.508553 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-b60d59ea-c58e-45a2-bc0a-db188c63576d req-f326a8ef-bc01-4675-b50c-4c4e9537f524 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:36.522363 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.compute.server_external_events [req-b60d59ea-c58e-45a2-bc0a-db188c63576d req-f326a8ef-bc01-4675-b50c-4c4e9537f524 service nova] Unable to find a host for instance bff12074-d8b0-4beb-9ddb-6e617f654908. Dropping event network-vif-unplugged {{(pid=120496) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 11 01:01:36.523216 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-b60d59ea-c58e-45a2-bc0a-db188c63576d req-f326a8ef-bc01-4675-b50c-4c4e9537f524 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.215466 Sep 11 01:01:36.523806 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 365/736] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 217 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 11 01:01:36.529138 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1e1dbf5e-63db-480f-abaa-0b334509659e tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-492462541"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:36.529829 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1e1dbf5e-63db-480f-abaa-0b334509659e tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:36.535103 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-e1898005-388c-4dca-b11f-05b28756adb2 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "POST /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.447782 Sep 11 01:01:36.535973 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 372/737] 10.222.0.23 () {62 vars in 1364 bytes} [Sun Sep 11 01:01:36 2022] POST /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908/os-volume_attachments => generated 188 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 01:01:36.538718 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e1dbf5e-63db-480f-abaa-0b334509659e tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:36.539338 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e1dbf5e-63db-480f-abaa-0b334509659e tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:36.539779 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e1dbf5e-63db-480f-abaa-0b334509659e tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:36.540482 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e1dbf5e-63db-480f-abaa-0b334509659e tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:36.541095 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e1dbf5e-63db-480f-abaa-0b334509659e tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:36.541585 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e1dbf5e-63db-480f-abaa-0b334509659e tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:36.673636 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3650db0f-e97f-4076-ba06-d02516745191 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:36.674119 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3650db0f-e97f-4076-ba06-d02516745191 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:36.680214 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3650db0f-e97f-4076-ba06-d02516745191 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:36.681293 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3650db0f-e97f-4076-ba06-d02516745191 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:36.681293 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3650db0f-e97f-4076-ba06-d02516745191 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:36.681685 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3650db0f-e97f-4076-ba06-d02516745191 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:36.682128 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3650db0f-e97f-4076-ba06-d02516745191 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:36.682585 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3650db0f-e97f-4076-ba06-d02516745191 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:36.702281 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.network.security_group_api [None req-1e1dbf5e-63db-480f-abaa-0b334509659e tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Adding security group ce2a4222-7b25-4dd8-ae38-3301340317e5 to port b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71 Sep 11 01:01:36.994563 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3650db0f-e97f-4076-ba06-d02516745191 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908/os-volume_attachments/6fa6a1f7-b67b-4aeb-b4ef-c1a49e72b68b" status: 202 len: 0 microversion: 2.20 time: 0.324809 Sep 11 01:01:36.995157 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 373/738] 10.222.0.23 () {60 vars in 1457 bytes} [Sun Sep 11 01:01:36 2022] DELETE /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908/os-volume_attachments/6fa6a1f7-b67b-4aeb-b4ef-c1a49e72b68b => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 11 01:01:37.058794 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-be0c15e2-35b5-48fc-93ee-94676ce205d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:37.059428 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-be0c15e2-35b5-48fc-93ee-94676ce205d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:37.061252 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=64 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:37.066477 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-be0c15e2-35b5-48fc-93ee-94676ce205d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:37.066960 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-be0c15e2-35b5-48fc-93ee-94676ce205d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:37.067464 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-be0c15e2-35b5-48fc-93ee-94676ce205d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:37.068407 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-be0c15e2-35b5-48fc-93ee-94676ce205d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:37.068855 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-be0c15e2-35b5-48fc-93ee-94676ce205d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:37.069272 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-be0c15e2-35b5-48fc-93ee-94676ce205d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:37.170810 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1e1dbf5e-63db-480f-abaa-0b334509659e tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "POST /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/action" status: 202 len: 0 microversion: 2.1 time: 0.645693 Sep 11 01:01:37.171446 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 366/739] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Sep 11 01:01:36 2022] POST /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:01:37.179660 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-97270f96-f427-42cc-b9b6-3cd06054e669 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:37.180436 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-97270f96-f427-42cc-b9b6-3cd06054e669 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:37.186594 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97270f96-f427-42cc-b9b6-3cd06054e669 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:37.187129 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97270f96-f427-42cc-b9b6-3cd06054e669 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:37.187591 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97270f96-f427-42cc-b9b6-3cd06054e669 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:37.188270 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97270f96-f427-42cc-b9b6-3cd06054e669 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:37.188713 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97270f96-f427-42cc-b9b6-3cd06054e669 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:37.189192 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97270f96-f427-42cc-b9b6-3cd06054e669 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:37.234639 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-be0c15e2-35b5-48fc-93ee-94676ce205d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120497) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 01:01:37.316606 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-be0c15e2-35b5-48fc-93ee-94676ce205d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "POST /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908/action" status: 202 len: 0 microversion: 2.20 time: 0.261269 Sep 11 01:01:37.320234 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 374/740] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Sep 11 01:01:37 2022] POST /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 01:01:37.325081 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-6da56cb6-68d7-4c9b-943a-29cc04b03999 req-dc3ddab9-6d86-4831-bc19-7f919e949346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65943bbe-32ae-424f-8341-ddf47713744f", "tag": "b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:37.336292 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-6da56cb6-68d7-4c9b-943a-29cc04b03999 req-dc3ddab9-6d86-4831-bc19-7f919e949346 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:37.336856 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-6da56cb6-68d7-4c9b-943a-29cc04b03999 req-dc3ddab9-6d86-4831-bc19-7f919e949346 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:37.337348 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-6da56cb6-68d7-4c9b-943a-29cc04b03999 req-dc3ddab9-6d86-4831-bc19-7f919e949346 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:37.350592 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-6da56cb6-68d7-4c9b-943a-29cc04b03999 req-dc3ddab9-6d86-4831-bc19-7f919e949346 service nova] Creating event network-changed:b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71 for instance 65943bbe-32ae-424f-8341-ddf47713744f on hv-cinder-maste Sep 11 01:01:37.357515 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-6da56cb6-68d7-4c9b-943a-29cc04b03999 req-dc3ddab9-6d86-4831-bc19-7f919e949346 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038802 Sep 11 01:01:37.363214 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 375/741] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:37.376536 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-dc53d3d6-7ae2-4424-9ca8-c0b0183cd223 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:37.378994 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-dc53d3d6-7ae2-4424-9ca8-c0b0183cd223 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:37.399020 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dc53d3d6-7ae2-4424-9ca8-c0b0183cd223 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:37.399989 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dc53d3d6-7ae2-4424-9ca8-c0b0183cd223 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:37.400622 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dc53d3d6-7ae2-4424-9ca8-c0b0183cd223 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:37.401655 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dc53d3d6-7ae2-4424-9ca8-c0b0183cd223 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:37.402474 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dc53d3d6-7ae2-4424-9ca8-c0b0183cd223 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:37.403317 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dc53d3d6-7ae2-4424-9ca8-c0b0183cd223 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:37.943072 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-97270f96-f427-42cc-b9b6-3cd06054e669 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:37.968764 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-97270f96-f427-42cc-b9b6-3cd06054e669 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1758 microversion: 2.1 time: 0.791123 Sep 11 01:01:37.970500 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 367/742] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:37 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1758 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:01:37.975481 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-dc53d3d6-7ae2-4424-9ca8-c0b0183cd223 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:37.988878 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-dc53d3d6-7ae2-4424-9ca8-c0b0183cd223 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:37.990313 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-dc53d3d6-7ae2-4424-9ca8-c0b0183cd223 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:37.991524 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-dc53d3d6-7ae2-4424-9ca8-c0b0183cd223 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1669 microversion: 2.20 time: 0.626579 Sep 11 01:01:37.992079 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 376/743] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:37 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1669 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:38.353397 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-60b9eb66-bd04-4acc-87ee-ed2a3f3d0eed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:38.353971 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-60b9eb66-bd04-4acc-87ee-ed2a3f3d0eed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:38.361314 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60b9eb66-bd04-4acc-87ee-ed2a3f3d0eed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:38.362244 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60b9eb66-bd04-4acc-87ee-ed2a3f3d0eed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:38.362909 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60b9eb66-bd04-4acc-87ee-ed2a3f3d0eed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:38.363869 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60b9eb66-bd04-4acc-87ee-ed2a3f3d0eed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:38.364567 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60b9eb66-bd04-4acc-87ee-ed2a3f3d0eed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:38.365372 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60b9eb66-bd04-4acc-87ee-ed2a3f3d0eed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:38.474505 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-60b9eb66-bd04-4acc-87ee-ed2a3f3d0eed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lazy-loading 'services' on Instance uuid 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:01:38.639455 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-60b9eb66-bd04-4acc-87ee-ed2a3f3d0eed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/os-volume_attachments/7f371037-780b-4f12-b0b3-57662e7c2941" status: 202 len: 0 microversion: 2.1 time: 0.289773 Sep 11 01:01:38.641775 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 368/744] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Sep 11 01:01:38 2022] DELETE /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/os-volume_attachments/7f371037-780b-4f12-b0b3-57662e7c2941 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:01:38.654389 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-2cbdaa3c-35e8-48b7-9c29-85a04b4c7d34 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:38.657694 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-2cbdaa3c-35e8-48b7-9c29-85a04b4c7d34 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:38.673128 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2cbdaa3c-35e8-48b7-9c29-85a04b4c7d34 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:38.673851 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2cbdaa3c-35e8-48b7-9c29-85a04b4c7d34 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:38.674340 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2cbdaa3c-35e8-48b7-9c29-85a04b4c7d34 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:38.675050 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2cbdaa3c-35e8-48b7-9c29-85a04b4c7d34 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:38.683080 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2cbdaa3c-35e8-48b7-9c29-85a04b4c7d34 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:38.683824 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2cbdaa3c-35e8-48b7-9c29-85a04b4c7d34 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:38.741489 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-2cbdaa3c-35e8-48b7-9c29-85a04b4c7d34 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093238 Sep 11 01:01:38.749433 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 377/745] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:01:38 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:38.759923 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3534d41f-193d-468f-be83-fc6e0064a17c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:38.762850 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3534d41f-193d-468f-be83-fc6e0064a17c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:38.771112 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3534d41f-193d-468f-be83-fc6e0064a17c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:38.771910 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3534d41f-193d-468f-be83-fc6e0064a17c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:38.772691 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3534d41f-193d-468f-be83-fc6e0064a17c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:38.773405 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3534d41f-193d-468f-be83-fc6e0064a17c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:38.773864 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3534d41f-193d-468f-be83-fc6e0064a17c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:38.774295 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3534d41f-193d-468f-be83-fc6e0064a17c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:38.808151 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3534d41f-193d-468f-be83-fc6e0064a17c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052993 Sep 11 01:01:38.808771 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 369/746] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:01:38 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 01:01:38.941062 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f7afd282-9061-4f29-beab-0cdcb6a2a2cc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:38.943473 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f7afd282-9061-4f29-beab-0cdcb6a2a2cc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:38.949783 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f7afd282-9061-4f29-beab-0cdcb6a2a2cc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:38.950364 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f7afd282-9061-4f29-beab-0cdcb6a2a2cc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:38.950863 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f7afd282-9061-4f29-beab-0cdcb6a2a2cc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:38.951721 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f7afd282-9061-4f29-beab-0cdcb6a2a2cc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:38.952311 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f7afd282-9061-4f29-beab-0cdcb6a2a2cc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:38.952794 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f7afd282-9061-4f29-beab-0cdcb6a2a2cc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:38.981968 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f7afd282-9061-4f29-beab-0cdcb6a2a2cc tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046049 Sep 11 01:01:38.982651 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 378/747] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:01:38 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 01:01:39.019702 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fecbca43-ccf2-42ca-9088-b8ac79fc2bb3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:39.020487 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-fecbca43-ccf2-42ca-9088-b8ac79fc2bb3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:39.026922 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fecbca43-ccf2-42ca-9088-b8ac79fc2bb3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:39.027741 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fecbca43-ccf2-42ca-9088-b8ac79fc2bb3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:39.028171 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fecbca43-ccf2-42ca-9088-b8ac79fc2bb3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:39.028867 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fecbca43-ccf2-42ca-9088-b8ac79fc2bb3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:39.029313 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fecbca43-ccf2-42ca-9088-b8ac79fc2bb3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:39.029826 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fecbca43-ccf2-42ca-9088-b8ac79fc2bb3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:39.053413 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-381f076e-6dbd-41f3-a3fc-98cc3bce5502 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:39.053959 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-381f076e-6dbd-41f3-a3fc-98cc3bce5502 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:39.060461 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-381f076e-6dbd-41f3-a3fc-98cc3bce5502 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:39.061135 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-381f076e-6dbd-41f3-a3fc-98cc3bce5502 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:39.061724 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-381f076e-6dbd-41f3-a3fc-98cc3bce5502 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:39.063236 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-381f076e-6dbd-41f3-a3fc-98cc3bce5502 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:39.063857 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-381f076e-6dbd-41f3-a3fc-98cc3bce5502 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:39.064428 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-381f076e-6dbd-41f3-a3fc-98cc3bce5502 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:39.097154 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-381f076e-6dbd-41f3-a3fc-98cc3bce5502 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Going to try to terminate instance {{(pid=120497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 01:01:39.181852 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-381f076e-6dbd-41f3-a3fc-98cc3bce5502 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 204 len: 0 microversion: 2.1 time: 0.132197 Sep 11 01:01:39.185868 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 379/748] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:01:39 2022] DELETE /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 01:01:39.192971 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-494fa725-0c06-4c37-acb8-35df5c127c9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:39.193740 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-494fa725-0c06-4c37-acb8-35df5c127c9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:39.200809 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-494fa725-0c06-4c37-acb8-35df5c127c9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:39.201137 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-494fa725-0c06-4c37-acb8-35df5c127c9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:39.201641 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-494fa725-0c06-4c37-acb8-35df5c127c9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:39.202415 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-494fa725-0c06-4c37-acb8-35df5c127c9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:39.203196 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-494fa725-0c06-4c37-acb8-35df5c127c9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:39.203833 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-494fa725-0c06-4c37-acb8-35df5c127c9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:39.238267 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-fecbca43-ccf2-42ca-9088-b8ac79fc2bb3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:39.263105 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-fecbca43-ccf2-42ca-9088-b8ac79fc2bb3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:39.265102 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-fecbca43-ccf2-42ca-9088-b8ac79fc2bb3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:39.266469 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-fecbca43-ccf2-42ca-9088-b8ac79fc2bb3 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1669 microversion: 2.20 time: 0.250748 Sep 11 01:01:39.267203 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 370/749] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:39 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1669 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:39.408129 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-494fa725-0c06-4c37-acb8-35df5c127c9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:39.417712 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-494fa725-0c06-4c37-acb8-35df5c127c9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1674 microversion: 2.1 time: 0.230316 Sep 11 01:01:39.418350 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 380/750] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:39 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1674 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:01:39.754366 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-13bc2974-71b8-44d6-9fcb-9d0de75d69ed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:39.756537 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-13bc2974-71b8-44d6-9fcb-9d0de75d69ed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:39.763731 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-13bc2974-71b8-44d6-9fcb-9d0de75d69ed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:39.764241 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-13bc2974-71b8-44d6-9fcb-9d0de75d69ed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:39.764672 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-13bc2974-71b8-44d6-9fcb-9d0de75d69ed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:39.765356 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-13bc2974-71b8-44d6-9fcb-9d0de75d69ed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:39.765808 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-13bc2974-71b8-44d6-9fcb-9d0de75d69ed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:39.766242 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-13bc2974-71b8-44d6-9fcb-9d0de75d69ed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:39.799149 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-13bc2974-71b8-44d6-9fcb-9d0de75d69ed tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048827 Sep 11 01:01:39.799749 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 371/751] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:01:39 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:40.273704 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1679461950", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452", "networks": [{"uuid": "fa575798-9ea6-4a2a-9ecf-6d434479577e"}]}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:40.293027 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-cc34c107-c0ec-4e63-be86-653360d84ced tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:40.293579 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-cc34c107-c0ec-4e63-be86-653360d84ced tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:40.299691 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cc34c107-c0ec-4e63-be86-653360d84ced tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:40.300246 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cc34c107-c0ec-4e63-be86-653360d84ced tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:40.300796 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cc34c107-c0ec-4e63-be86-653360d84ced tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:40.301693 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cc34c107-c0ec-4e63-be86-653360d84ced tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:40.302107 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cc34c107-c0ec-4e63-be86-653360d84ced tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:40.302740 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cc34c107-c0ec-4e63-be86-653360d84ced tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:40.328628 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.network.neutron [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] validate_networks() for [('fa575798-9ea6-4a2a-9ecf-6d434479577e', None, None, None, None, None)] {{(pid=120497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 01:01:40.526876 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-cc34c107-c0ec-4e63-be86-653360d84ced tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:40.535599 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-cc34c107-c0ec-4e63-be86-653360d84ced tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:40.536956 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-cc34c107-c0ec-4e63-be86-653360d84ced tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:40.538474 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-cc34c107-c0ec-4e63-be86-653360d84ced tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1671 microversion: 2.20 time: 0.249800 Sep 11 01:01:40.539037 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 372/752] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:40 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1671 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:40.550849 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-313a406f-dd5f-45b9-bf17-5a0f6bce64ce tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:40.551585 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-313a406f-dd5f-45b9-bf17-5a0f6bce64ce tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:40.557634 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-313a406f-dd5f-45b9-bf17-5a0f6bce64ce tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:40.558542 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-313a406f-dd5f-45b9-bf17-5a0f6bce64ce tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:40.558972 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-313a406f-dd5f-45b9-bf17-5a0f6bce64ce tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:40.559677 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-313a406f-dd5f-45b9-bf17-5a0f6bce64ce tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:40.560121 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-313a406f-dd5f-45b9-bf17-5a0f6bce64ce tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:40.560537 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-313a406f-dd5f-45b9-bf17-5a0f6bce64ce tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:40.781271 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-313a406f-dd5f-45b9-bf17-5a0f6bce64ce tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:40.790264 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-313a406f-dd5f-45b9-bf17-5a0f6bce64ce tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1674 microversion: 2.1 time: 0.243124 Sep 11 01:01:40.790921 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 373/753] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:40 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1674 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:40.811932 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6df277cf-e4e9-4f0a-a925-779449e523a9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:40.814064 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6df277cf-e4e9-4f0a-a925-779449e523a9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:40.818381 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Flavor limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 01:01:40.818779 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Image limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 01:01:40.819333 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Flavor pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 01:01:40.819746 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Image pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 01:01:40.820077 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6df277cf-e4e9-4f0a-a925-779449e523a9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:40.820220 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 01:01:40.820562 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6df277cf-e4e9-4f0a-a925-779449e523a9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:40.821173 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6df277cf-e4e9-4f0a-a925-779449e523a9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:40.822481 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6df277cf-e4e9-4f0a-a925-779449e523a9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:40.824606 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6df277cf-e4e9-4f0a-a925-779449e523a9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:40.825054 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6df277cf-e4e9-4f0a-a925-779449e523a9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:40.829881 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:40.830388 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:40.831079 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:40.832218 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:40.832700 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:40.833115 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:40.839875 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:40.850410 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Getting quotas for project 6b1f92f790a043bf9848695a5c517857. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 01:01:40.854889 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Getting quotas for user 26e7fce78cc74e0aace9b0956762c126 and project 6b1f92f790a043bf9848695a5c517857. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 01:01:40.858258 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6df277cf-e4e9-4f0a-a925-779449e523a9 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050297 Sep 11 01:01:40.858855 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 374/754] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:01:40 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:40.866111 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Going to run 1 instances... {{(pid=120497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 01:01:40.868434 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 01:01:40.923864 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c14a7a46-5e9a-4c98-9e35-9680af027ba5 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769895 Sep 11 01:01:40.924417 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 381/755] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 01:01:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 01:01:40.935763 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-16bc719c-ba30-42e5-b52e-0de69c27005c tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:40.936377 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-16bc719c-ba30-42e5-b52e-0de69c27005c tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:40.989614 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-16bc719c-ba30-42e5-b52e-0de69c27005c tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:40.997337 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-16bc719c-ba30-42e5-b52e-0de69c27005c tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1214 microversion: 2.1 time: 0.065504 Sep 11 01:01:40.997910 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 375/756] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:40 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:41.564825 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c6ece76c-7790-45ab-96fa-69240c7a8f35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:41.566190 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c6ece76c-7790-45ab-96fa-69240c7a8f35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:41.574342 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c6ece76c-7790-45ab-96fa-69240c7a8f35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:41.575165 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c6ece76c-7790-45ab-96fa-69240c7a8f35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:41.576035 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c6ece76c-7790-45ab-96fa-69240c7a8f35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:41.577182 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c6ece76c-7790-45ab-96fa-69240c7a8f35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:41.577850 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c6ece76c-7790-45ab-96fa-69240c7a8f35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:41.578809 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c6ece76c-7790-45ab-96fa-69240c7a8f35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:41.598290 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=7,nova_cell1:UPDATE=10 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:41.813548 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bb116809-e7b5-4aa3-a0fc-a0bef2f0c75d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:41.814270 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bb116809-e7b5-4aa3-a0fc-a0bef2f0c75d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:41.821167 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bb116809-e7b5-4aa3-a0fc-a0bef2f0c75d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:41.821751 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bb116809-e7b5-4aa3-a0fc-a0bef2f0c75d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:41.822253 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bb116809-e7b5-4aa3-a0fc-a0bef2f0c75d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:41.823019 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bb116809-e7b5-4aa3-a0fc-a0bef2f0c75d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:41.823497 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bb116809-e7b5-4aa3-a0fc-a0bef2f0c75d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:41.823922 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bb116809-e7b5-4aa3-a0fc-a0bef2f0c75d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:41.840371 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c6ece76c-7790-45ab-96fa-69240c7a8f35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:41.850197 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c6ece76c-7790-45ab-96fa-69240c7a8f35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:41.851712 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c6ece76c-7790-45ab-96fa-69240c7a8f35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:41.852873 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c6ece76c-7790-45ab-96fa-69240c7a8f35 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.293458 Sep 11 01:01:41.853602 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 382/757] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:41 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 01:01:41.870476 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-ae1949b4-6c01-4e39-bd52-6f9033e86b81 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:41.875002 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-ae1949b4-6c01-4e39-bd52-6f9033e86b81 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:41.881830 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ae1949b4-6c01-4e39-bd52-6f9033e86b81 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:41.882468 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ae1949b4-6c01-4e39-bd52-6f9033e86b81 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:41.882900 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ae1949b4-6c01-4e39-bd52-6f9033e86b81 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:41.883679 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ae1949b4-6c01-4e39-bd52-6f9033e86b81 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:41.884120 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ae1949b4-6c01-4e39-bd52-6f9033e86b81 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:41.884533 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-ae1949b4-6c01-4e39-bd52-6f9033e86b81 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:41.915716 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-ae1949b4-6c01-4e39-bd52-6f9033e86b81 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049040 Sep 11 01:01:41.916315 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 383/758] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:01:41 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 01:01:41.983325 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-21854b27-4758-463b-af49-6bdb5258bb99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:41.983739 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-21854b27-4758-463b-af49-6bdb5258bb99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:41.989916 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-21854b27-4758-463b-af49-6bdb5258bb99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:41.990389 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-21854b27-4758-463b-af49-6bdb5258bb99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:41.990814 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-21854b27-4758-463b-af49-6bdb5258bb99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:41.991529 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-21854b27-4758-463b-af49-6bdb5258bb99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:41.991973 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-21854b27-4758-463b-af49-6bdb5258bb99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:41.992387 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-21854b27-4758-463b-af49-6bdb5258bb99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:42.023386 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-21854b27-4758-463b-af49-6bdb5258bb99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Going to try to terminate instance {{(pid=120497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 01:01:42.102627 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-21854b27-4758-463b-af49-6bdb5258bb99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 204 len: 0 microversion: 2.1 time: 0.123296 Sep 11 01:01:42.103561 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 384/759] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:01:41 2022] DELETE /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 01:01:42.108675 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6ddf877f-d130-40db-b77b-b9091c7f9599 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:42.109495 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6ddf877f-d130-40db-b77b-b9091c7f9599 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:42.115494 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6ddf877f-d130-40db-b77b-b9091c7f9599 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:42.115976 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6ddf877f-d130-40db-b77b-b9091c7f9599 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:42.116408 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6ddf877f-d130-40db-b77b-b9091c7f9599 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:42.117103 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6ddf877f-d130-40db-b77b-b9091c7f9599 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:42.117572 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6ddf877f-d130-40db-b77b-b9091c7f9599 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:42.117999 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6ddf877f-d130-40db-b77b-b9091c7f9599 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:42.153647 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-bb116809-e7b5-4aa3-a0fc-a0bef2f0c75d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:42.163884 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bb116809-e7b5-4aa3-a0fc-a0bef2f0c75d tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1674 microversion: 2.1 time: 0.353806 Sep 11 01:01:42.164552 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 376/760] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:41 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1674 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:42.184503 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1256768b-412b-42f6-b29f-b5c6c8f0d49d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:42.185116 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1256768b-412b-42f6-b29f-b5c6c8f0d49d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:42.186967 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=76 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:42.192312 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1256768b-412b-42f6-b29f-b5c6c8f0d49d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:42.192792 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1256768b-412b-42f6-b29f-b5c6c8f0d49d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:42.193223 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1256768b-412b-42f6-b29f-b5c6c8f0d49d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:42.193920 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1256768b-412b-42f6-b29f-b5c6c8f0d49d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:42.194547 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1256768b-412b-42f6-b29f-b5c6c8f0d49d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:42.195130 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1256768b-412b-42f6-b29f-b5c6c8f0d49d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:42.196307 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6ddf877f-d130-40db-b77b-b9091c7f9599 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:42.204155 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6ddf877f-d130-40db-b77b-b9091c7f9599 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1266 microversion: 2.1 time: 0.099444 Sep 11 01:01:42.205105 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 385/761] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:42 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:42.432541 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1256768b-412b-42f6-b29f-b5c6c8f0d49d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:42.440521 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1256768b-412b-42f6-b29f-b5c6c8f0d49d tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1682 microversion: 2.1 time: 0.259911 Sep 11 01:01:42.441117 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 377/762] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:42 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1682 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:42.696434 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-892878d9-4036-4c2b-ae23-7c8e66dbeb74 req-47f1fccd-6611-4363-a949-f3f318b60e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb3eb557-558f-456d-83b2-23769926f3ca", "name": "network-vif-deleted", "tag": "e9163d63-c63f-4164-9500-b11dcb2c600e"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:42.706356 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-892878d9-4036-4c2b-ae23-7c8e66dbeb74 req-47f1fccd-6611-4363-a949-f3f318b60e59 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:42.706833 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-892878d9-4036-4c2b-ae23-7c8e66dbeb74 req-47f1fccd-6611-4363-a949-f3f318b60e59 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:42.707283 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-892878d9-4036-4c2b-ae23-7c8e66dbeb74 req-47f1fccd-6611-4363-a949-f3f318b60e59 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:42.718551 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-892878d9-4036-4c2b-ae23-7c8e66dbeb74 req-47f1fccd-6611-4363-a949-f3f318b60e59 service nova] Creating event network-vif-deleted:e9163d63-c63f-4164-9500-b11dcb2c600e for instance bb3eb557-558f-456d-83b2-23769926f3ca on hv-cinder-maste Sep 11 01:01:42.723531 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-892878d9-4036-4c2b-ae23-7c8e66dbeb74 req-47f1fccd-6611-4363-a949-f3f318b60e59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031334 Sep 11 01:01:42.724121 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 386/763] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:42.881024 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-881e15cc-7368-47b1-a8b7-cc1cc3818628 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:42.882326 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-881e15cc-7368-47b1-a8b7-cc1cc3818628 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:42.889174 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-881e15cc-7368-47b1-a8b7-cc1cc3818628 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:42.889995 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-881e15cc-7368-47b1-a8b7-cc1cc3818628 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:42.890494 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-881e15cc-7368-47b1-a8b7-cc1cc3818628 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:42.891324 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-881e15cc-7368-47b1-a8b7-cc1cc3818628 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:42.891845 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-881e15cc-7368-47b1-a8b7-cc1cc3818628 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:42.892334 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-881e15cc-7368-47b1-a8b7-cc1cc3818628 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:43.027643 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-881e15cc-7368-47b1-a8b7-cc1cc3818628 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:43.035998 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-881e15cc-7368-47b1-a8b7-cc1cc3818628 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:43.037446 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-881e15cc-7368-47b1-a8b7-cc1cc3818628 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:43.038987 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-881e15cc-7368-47b1-a8b7-cc1cc3818628 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.161910 Sep 11 01:01:43.039589 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 378/764] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:42 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:43.188280 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c905cf0e-bbef-47a2-9e7e-1a7a670966e5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:43.188978 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-c905cf0e-bbef-47a2-9e7e-1a7a670966e5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:43.195554 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c905cf0e-bbef-47a2-9e7e-1a7a670966e5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:43.196034 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c905cf0e-bbef-47a2-9e7e-1a7a670966e5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:43.196463 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c905cf0e-bbef-47a2-9e7e-1a7a670966e5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:43.197155 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c905cf0e-bbef-47a2-9e7e-1a7a670966e5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:43.197601 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c905cf0e-bbef-47a2-9e7e-1a7a670966e5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:43.198017 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-c905cf0e-bbef-47a2-9e7e-1a7a670966e5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:43.227411 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c4bb718d-112f-400e-a8d4-d77566e80c6f tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:43.228013 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c4bb718d-112f-400e-a8d4-d77566e80c6f tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:43.234577 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c4bb718d-112f-400e-a8d4-d77566e80c6f tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:43.235058 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c4bb718d-112f-400e-a8d4-d77566e80c6f tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:43.235511 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c4bb718d-112f-400e-a8d4-d77566e80c6f tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:43.236169 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c4bb718d-112f-400e-a8d4-d77566e80c6f tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:43.236866 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c4bb718d-112f-400e-a8d4-d77566e80c6f tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:43.237279 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c4bb718d-112f-400e-a8d4-d77566e80c6f tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:43.261222 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-c905cf0e-bbef-47a2-9e7e-1a7a670966e5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:43.269532 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c905cf0e-bbef-47a2-9e7e-1a7a670966e5 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1606 microversion: 2.1 time: 0.085530 Sep 11 01:01:43.270109 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 387/765] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:43 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1606 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:43.301843 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c4bb718d-112f-400e-a8d4-d77566e80c6f tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:43.309611 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c4bb718d-112f-400e-a8d4-d77566e80c6f tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1266 microversion: 2.1 time: 0.086133 Sep 11 01:01:43.310186 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 379/766] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:43 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:01:43.463711 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-146e217b-e17d-4564-bc2c-f74797ba9c4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:43.464313 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-146e217b-e17d-4564-bc2c-f74797ba9c4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:43.471121 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-146e217b-e17d-4564-bc2c-f74797ba9c4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:43.471652 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-146e217b-e17d-4564-bc2c-f74797ba9c4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:43.472092 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-146e217b-e17d-4564-bc2c-f74797ba9c4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:43.472814 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-146e217b-e17d-4564-bc2c-f74797ba9c4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:43.473262 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-146e217b-e17d-4564-bc2c-f74797ba9c4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:43.473686 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-146e217b-e17d-4564-bc2c-f74797ba9c4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:43.613805 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-146e217b-e17d-4564-bc2c-f74797ba9c4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:43.622483 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-146e217b-e17d-4564-bc2c-f74797ba9c4e tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1682 microversion: 2.1 time: 0.162671 Sep 11 01:01:43.623142 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 388/767] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:43 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:44.068634 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b79c32bd-0bc3-4d2a-80fc-706547dfef96 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:44.069265 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b79c32bd-0bc3-4d2a-80fc-706547dfef96 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:44.075693 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b79c32bd-0bc3-4d2a-80fc-706547dfef96 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:44.076177 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b79c32bd-0bc3-4d2a-80fc-706547dfef96 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:44.076758 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b79c32bd-0bc3-4d2a-80fc-706547dfef96 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:44.077465 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b79c32bd-0bc3-4d2a-80fc-706547dfef96 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:44.077920 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b79c32bd-0bc3-4d2a-80fc-706547dfef96 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:44.078341 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b79c32bd-0bc3-4d2a-80fc-706547dfef96 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:44.240650 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b79c32bd-0bc3-4d2a-80fc-706547dfef96 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:44.249300 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b79c32bd-0bc3-4d2a-80fc-706547dfef96 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:44.250730 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b79c32bd-0bc3-4d2a-80fc-706547dfef96 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:44.251927 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b79c32bd-0bc3-4d2a-80fc-706547dfef96 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.187808 Sep 11 01:01:44.252460 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 380/768] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:44 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:44.295950 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-1fca7d81-ba40-4609-bc5b-cf45ba05ecb1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:44.296921 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-1fca7d81-ba40-4609-bc5b-cf45ba05ecb1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:44.307100 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fca7d81-ba40-4609-bc5b-cf45ba05ecb1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:44.307855 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fca7d81-ba40-4609-bc5b-cf45ba05ecb1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:44.308519 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fca7d81-ba40-4609-bc5b-cf45ba05ecb1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:44.309416 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fca7d81-ba40-4609-bc5b-cf45ba05ecb1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:44.309873 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fca7d81-ba40-4609-bc5b-cf45ba05ecb1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:44.310308 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fca7d81-ba40-4609-bc5b-cf45ba05ecb1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:44.333820 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bd6ec537-f374-4734-81c0-0c4ab0b17fbb tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:44.334434 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bd6ec537-f374-4734-81c0-0c4ab0b17fbb tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:44.341000 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd6ec537-f374-4734-81c0-0c4ab0b17fbb tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:44.341754 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd6ec537-f374-4734-81c0-0c4ab0b17fbb tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:44.342395 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fca7d81-ba40-4609-bc5b-cf45ba05ecb1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:44.342580 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd6ec537-f374-4734-81c0-0c4ab0b17fbb tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:44.342881 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fca7d81-ba40-4609-bc5b-cf45ba05ecb1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:44.343164 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd6ec537-f374-4734-81c0-0c4ab0b17fbb tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:44.343381 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fca7d81-ba40-4609-bc5b-cf45ba05ecb1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:44.343646 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd6ec537-f374-4734-81c0-0c4ab0b17fbb tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:44.343764 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-1fca7d81-ba40-4609-bc5b-cf45ba05ecb1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lazy-loading 'fault' on Instance uuid bb3eb557-558f-456d-83b2-23769926f3ca {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:01:44.344084 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd6ec537-f374-4734-81c0-0c4ab0b17fbb tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:44.704353 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1fca7d81-ba40-4609-bc5b-cf45ba05ecb1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '081d365c7b15443aa76c7da2ca444a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dec451848364c2787673580ec4c90c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:44.710577 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-bd6ec537-f374-4734-81c0-0c4ab0b17fbb tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:44.712912 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-1fca7d81-ba40-4609-bc5b-cf45ba05ecb1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 200 len: 1327 microversion: 2.1 time: 0.423025 Sep 11 01:01:44.714012 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 389/769] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:44 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 1327 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:44.720867 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b09fedf7-5b3c-4a76-975a-780f38752246 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:44.721617 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-b09fedf7-5b3c-4a76-975a-780f38752246 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:44.722404 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bd6ec537-f374-4734-81c0-0c4ab0b17fbb tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1266 microversion: 2.1 time: 0.393027 Sep 11 01:01:44.735616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b09fedf7-5b3c-4a76-975a-780f38752246 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:44.735616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b09fedf7-5b3c-4a76-975a-780f38752246 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:44.735616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b09fedf7-5b3c-4a76-975a-780f38752246 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:44.735616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b09fedf7-5b3c-4a76-975a-780f38752246 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:44.735937 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b09fedf7-5b3c-4a76-975a-780f38752246 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:44.735937 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b09fedf7-5b3c-4a76-975a-780f38752246 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:44.736463 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 381/770] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:44 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1266 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:45.037290 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-b09fedf7-5b3c-4a76-975a-780f38752246 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:45.046318 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-b09fedf7-5b3c-4a76-975a-780f38752246 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1682 microversion: 2.1 time: 0.330145 Sep 11 01:01:45.054398 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 390/771] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:44 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1682 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:45.288480 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aa027756-e998-49eb-881b-f49f14c7d71e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:45.289938 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-aa027756-e998-49eb-881b-f49f14c7d71e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:45.299864 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa027756-e998-49eb-881b-f49f14c7d71e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:45.300797 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa027756-e998-49eb-881b-f49f14c7d71e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:45.301626 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa027756-e998-49eb-881b-f49f14c7d71e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:45.302569 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa027756-e998-49eb-881b-f49f14c7d71e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:45.303233 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa027756-e998-49eb-881b-f49f14c7d71e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:45.303857 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa027756-e998-49eb-881b-f49f14c7d71e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:45.534650 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-aa027756-e998-49eb-881b-f49f14c7d71e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:45.545926 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-aa027756-e998-49eb-881b-f49f14c7d71e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:45.547694 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-aa027756-e998-49eb-881b-f49f14c7d71e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:45.549325 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-aa027756-e998-49eb-881b-f49f14c7d71e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.265220 Sep 11 01:01:45.550407 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 382/772] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:45 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:45.736187 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-cc37176c-6c07-4625-be09-a3f126f5fc9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:45.736800 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-cc37176c-6c07-4625-be09-a3f126f5fc9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:45.748268 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-432622c5-2fd0-47d8-a948-092549ef3415 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:45.749130 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-432622c5-2fd0-47d8-a948-092549ef3415 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:45.755993 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cc37176c-6c07-4625-be09-a3f126f5fc9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:45.756419 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cc37176c-6c07-4625-be09-a3f126f5fc9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:45.756872 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cc37176c-6c07-4625-be09-a3f126f5fc9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:45.759254 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-432622c5-2fd0-47d8-a948-092549ef3415 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:45.759959 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-432622c5-2fd0-47d8-a948-092549ef3415 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:45.760727 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-432622c5-2fd0-47d8-a948-092549ef3415 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:45.761344 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cc37176c-6c07-4625-be09-a3f126f5fc9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:45.762319 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-432622c5-2fd0-47d8-a948-092549ef3415 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:45.763032 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cc37176c-6c07-4625-be09-a3f126f5fc9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:45.763653 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cc37176c-6c07-4625-be09-a3f126f5fc9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:45.764292 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-432622c5-2fd0-47d8-a948-092549ef3415 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:45.766061 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-432622c5-2fd0-47d8-a948-092549ef3415 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:45.806486 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-cc37176c-6c07-4625-be09-a3f126f5fc9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] HTTP exception thrown: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-cc37176c-6c07-4625-be09-a3f126f5fc9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Request method failure captured: Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca HTTP/1.1 Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTIatU_rUWvJEnf3ctReKwprorKx05nzV7nHw_OTBlBxETZeTyg0kxFYPpH2M0OOy-RufMmUSzoemhw45mD_uk5B5djfJSdIUzm9kQyDdjZocylxf_hiWpEA5xgC1ECqaIe1lR_NGPkxp_hCmmlRWk4hGgZyQFRS9saXvJyyOTusGd4 Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 4dec451848364c2787673580ec4c90c1 Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:01:45.808978 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:01:45.810413 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4dec451848364c2787673580ec4c90c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4dec451848364c2787673580ec4c90c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4dec451848364c2787673580ec4c90c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4dec451848364c2787673580ec4c90c1", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:45.810413 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:45.810413 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 4dec451848364c2787673580ec4c90c1 Sep 11 01:01:45.810413 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:45.810413 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-AttachVolumeTestJSON-612483322-project Sep 11 01:01:45.810413 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:01:45.810413 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:01:45.810413 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 081d365c7b15443aa76c7da2ca444a8e Sep 11 01:01:45.810413 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-AttachVolumeTestJSON-612483322-project Sep 11 01:01:45.810413 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 01:01:45.810413 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:45.810413 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': 'bb3eb557-558f-456d-83b2-23769926f3ca'} Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:45.811527 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:45.812884 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:45.821964 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-cc37176c-6c07-4625-be09-a3f126f5fc9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Returning 404 to user: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:45.826319 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-cc37176c-6c07-4625-be09-a3f126f5fc9e tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 404 len: 111 microversion: 2.1 time: 0.094000 Sep 11 01:01:45.830544 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 391/773] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:45 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:01:45.838529 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d5882357-640b-4a9b-bb82-0a58dd6faf3f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '.version_select at 0x7fbb90538310>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:45.874892 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d5882357-640b-4a9b-bb82-0a58dd6faf3f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-538889960" status: 202 len: 0 microversion: 2.1 time: 0.041162 Sep 11 01:01:45.879764 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 392/774] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Sep 11 01:01:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-538889960 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:01:46.072939 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-be7952f1-ca10-4a07-bc26-da7126f8073f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:46.073550 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-be7952f1-ca10-4a07-bc26-da7126f8073f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:46.092032 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-be7952f1-ca10-4a07-bc26-da7126f8073f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:46.094130 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-be7952f1-ca10-4a07-bc26-da7126f8073f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:46.094975 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-be7952f1-ca10-4a07-bc26-da7126f8073f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:46.099095 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-be7952f1-ca10-4a07-bc26-da7126f8073f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:46.100247 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-be7952f1-ca10-4a07-bc26-da7126f8073f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:46.103877 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-be7952f1-ca10-4a07-bc26-da7126f8073f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:46.319907 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-be7952f1-ca10-4a07-bc26-da7126f8073f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:46.343398 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-432622c5-2fd0-47d8-a948-092549ef3415 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:46.347991 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-be7952f1-ca10-4a07-bc26-da7126f8073f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1326 microversion: 2.1 time: 0.281223 Sep 11 01:01:46.365967 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-432622c5-2fd0-47d8-a948-092549ef3415 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.608068 Sep 11 01:01:46.365967 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 383/775] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:45 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:46.369387 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 393/776] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:46 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1326 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:01:46.375232 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-95461e50-e309-4c32-b5cf-2fcefeb7753f req-6e881c1f-4cec-4922-bff1-8529c2e6de94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf3c5f1-9b78-4721-97e4-170c26cbf0ff", "name": "network-vif-deleted", "tag": "c9d534bc-7ccd-4776-bdcc-c40c6c04e9fa"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:46.396748 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-95461e50-e309-4c32-b5cf-2fcefeb7753f req-6e881c1f-4cec-4922-bff1-8529c2e6de94 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:46.397313 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-95461e50-e309-4c32-b5cf-2fcefeb7753f req-6e881c1f-4cec-4922-bff1-8529c2e6de94 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:46.398016 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-95461e50-e309-4c32-b5cf-2fcefeb7753f req-6e881c1f-4cec-4922-bff1-8529c2e6de94 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:46.415215 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-95461e50-e309-4c32-b5cf-2fcefeb7753f req-6e881c1f-4cec-4922-bff1-8529c2e6de94 service nova] Creating event network-vif-deleted:c9d534bc-7ccd-4776-bdcc-c40c6c04e9fa for instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff on hv-cinder-maste Sep 11 01:01:46.423644 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-95461e50-e309-4c32-b5cf-2fcefeb7753f req-6e881c1f-4cec-4922-bff1-8529c2e6de94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064573 Sep 11 01:01:46.425488 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 384/777] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:46.497648 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-c2843f04-3ff3-44fe-9e2a-daa638e4c2cf req-d65873c9-6fad-4f13-bbba-9d0491a538c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5bd672b-a759-47a8-8c53-7f54e272cc46", "tag": "80f34462-a935-454d-99ce-542f2487460d"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:46.515086 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-c2843f04-3ff3-44fe-9e2a-daa638e4c2cf req-d65873c9-6fad-4f13-bbba-9d0491a538c7 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:46.520022 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-c2843f04-3ff3-44fe-9e2a-daa638e4c2cf req-d65873c9-6fad-4f13-bbba-9d0491a538c7 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:46.520513 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-c2843f04-3ff3-44fe-9e2a-daa638e4c2cf req-d65873c9-6fad-4f13-bbba-9d0491a538c7 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:46.565092 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-c2843f04-3ff3-44fe-9e2a-daa638e4c2cf req-d65873c9-6fad-4f13-bbba-9d0491a538c7 service nova] Creating event network-changed:80f34462-a935-454d-99ce-542f2487460d for instance e5bd672b-a759-47a8-8c53-7f54e272cc46 on hv-cinder-maste Sep 11 01:01:46.573300 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-c2843f04-3ff3-44fe-9e2a-daa638e4c2cf req-d65873c9-6fad-4f13-bbba-9d0491a538c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200929 Sep 11 01:01:46.574426 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 394/778] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:01:46.581616 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2e5695e3-874d-4d33-aa51-243288e7f8d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:46.584818 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2e5695e3-874d-4d33-aa51-243288e7f8d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:46.604813 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e5695e3-874d-4d33-aa51-243288e7f8d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:46.607813 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e5695e3-874d-4d33-aa51-243288e7f8d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:46.610086 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e5695e3-874d-4d33-aa51-243288e7f8d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:46.613292 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e5695e3-874d-4d33-aa51-243288e7f8d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:46.615644 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e5695e3-874d-4d33-aa51-243288e7f8d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:46.617325 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e5695e3-874d-4d33-aa51-243288e7f8d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:46.875049 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-2e5695e3-874d-4d33-aa51-243288e7f8d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:46.891264 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-2e5695e3-874d-4d33-aa51-243288e7f8d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:46.894778 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-2e5695e3-874d-4d33-aa51-243288e7f8d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:46.899435 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2e5695e3-874d-4d33-aa51-243288e7f8d4 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.324278 Sep 11 01:01:46.902210 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 385/779] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:46 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:47.375814 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8c33b85f-d14c-4529-bb1d-72849420f209 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:47.377131 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-8c33b85f-d14c-4529-bb1d-72849420f209 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:47.379508 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6207043a-11bf-48fd-892f-d006321f1492 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:47.380646 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6207043a-11bf-48fd-892f-d006321f1492 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:47.386142 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8c33b85f-d14c-4529-bb1d-72849420f209 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:47.387169 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8c33b85f-d14c-4529-bb1d-72849420f209 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:47.387994 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8c33b85f-d14c-4529-bb1d-72849420f209 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:47.389013 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8c33b85f-d14c-4529-bb1d-72849420f209 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:47.389677 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8c33b85f-d14c-4529-bb1d-72849420f209 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:47.390400 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8c33b85f-d14c-4529-bb1d-72849420f209 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:47.396802 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6207043a-11bf-48fd-892f-d006321f1492 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:47.397288 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6207043a-11bf-48fd-892f-d006321f1492 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:47.397716 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6207043a-11bf-48fd-892f-d006321f1492 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:47.402253 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6207043a-11bf-48fd-892f-d006321f1492 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:47.402863 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6207043a-11bf-48fd-892f-d006321f1492 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:47.403319 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6207043a-11bf-48fd-892f-d006321f1492 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:47.465309 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8c33b85f-d14c-4529-bb1d-72849420f209 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:47.466065 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8c33b85f-d14c-4529-bb1d-72849420f209 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:47.466652 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8c33b85f-d14c-4529-bb1d-72849420f209 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:47.467578 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-8c33b85f-d14c-4529-bb1d-72849420f209 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lazy-loading 'fault' on Instance uuid 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:01:47.531616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8c33b85f-d14c-4529-bb1d-72849420f209 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:47.549619 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8c33b85f-d14c-4529-bb1d-72849420f209 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1331 microversion: 2.1 time: 0.178467 Sep 11 01:01:47.571326 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 395/780] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:47 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1331 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:47.681645 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-6207043a-11bf-48fd-892f-d006321f1492 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:47.690909 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6207043a-11bf-48fd-892f-d006321f1492 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.315398 Sep 11 01:01:47.692333 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 386/781] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:47 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:47.927020 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-bb4a8c17-a14b-49d5-92cf-93b790cab9f7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:47.927670 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-bb4a8c17-a14b-49d5-92cf-93b790cab9f7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:47.934638 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bb4a8c17-a14b-49d5-92cf-93b790cab9f7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:47.936235 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bb4a8c17-a14b-49d5-92cf-93b790cab9f7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:47.936846 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bb4a8c17-a14b-49d5-92cf-93b790cab9f7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:47.937675 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bb4a8c17-a14b-49d5-92cf-93b790cab9f7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:47.938255 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bb4a8c17-a14b-49d5-92cf-93b790cab9f7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:47.939616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-bb4a8c17-a14b-49d5-92cf-93b790cab9f7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:48.082916 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-bb4a8c17-a14b-49d5-92cf-93b790cab9f7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:48.093117 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-bb4a8c17-a14b-49d5-92cf-93b790cab9f7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:48.094625 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-bb4a8c17-a14b-49d5-92cf-93b790cab9f7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:48.095801 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-bb4a8c17-a14b-49d5-92cf-93b790cab9f7 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.172988 Sep 11 01:01:48.096469 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 396/782] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:47 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:48.585445 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c0987b80-1611-4822-b95c-42b6c41b2665 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:48.586920 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c0987b80-1611-4822-b95c-42b6c41b2665 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:48.594469 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0987b80-1611-4822-b95c-42b6c41b2665 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:48.594961 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0987b80-1611-4822-b95c-42b6c41b2665 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:48.595584 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0987b80-1611-4822-b95c-42b6c41b2665 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:48.596296 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0987b80-1611-4822-b95c-42b6c41b2665 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:48.596744 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0987b80-1611-4822-b95c-42b6c41b2665 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:48.597169 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0987b80-1611-4822-b95c-42b6c41b2665 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:48.632695 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0987b80-1611-4822-b95c-42b6c41b2665 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:48.633190 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0987b80-1611-4822-b95c-42b6c41b2665 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:48.633603 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0987b80-1611-4822-b95c-42b6c41b2665 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:48.634087 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-c0987b80-1611-4822-b95c-42b6c41b2665 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lazy-loading 'fault' on Instance uuid 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:01:48.680377 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c0987b80-1611-4822-b95c-42b6c41b2665 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:48.693913 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c0987b80-1611-4822-b95c-42b6c41b2665 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1331 microversion: 2.1 time: 0.113536 Sep 11 01:01:48.694594 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 387/783] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:48 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:48.718957 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6c5a70d9-0916-4c6f-8020-1a25fdba32e1 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:48.719722 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6c5a70d9-0916-4c6f-8020-1a25fdba32e1 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:48.728421 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6c5a70d9-0916-4c6f-8020-1a25fdba32e1 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:48.728749 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6c5a70d9-0916-4c6f-8020-1a25fdba32e1 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:48.729177 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6c5a70d9-0916-4c6f-8020-1a25fdba32e1 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:48.733205 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6c5a70d9-0916-4c6f-8020-1a25fdba32e1 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:48.733668 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6c5a70d9-0916-4c6f-8020-1a25fdba32e1 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:48.734091 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6c5a70d9-0916-4c6f-8020-1a25fdba32e1 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:48.888471 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6c5a70d9-0916-4c6f-8020-1a25fdba32e1 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:48.900947 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6c5a70d9-0916-4c6f-8020-1a25fdba32e1 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.183845 Sep 11 01:01:48.901377 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 397/784] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:48 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:49.121302 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8bd4364f-a2d9-4f35-b9e6-9969c69df2cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:49.122107 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8bd4364f-a2d9-4f35-b9e6-9969c69df2cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:49.128818 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8bd4364f-a2d9-4f35-b9e6-9969c69df2cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:49.129309 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8bd4364f-a2d9-4f35-b9e6-9969c69df2cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:49.129741 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8bd4364f-a2d9-4f35-b9e6-9969c69df2cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:49.130447 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8bd4364f-a2d9-4f35-b9e6-9969c69df2cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:49.130896 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8bd4364f-a2d9-4f35-b9e6-9969c69df2cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:49.131346 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8bd4364f-a2d9-4f35-b9e6-9969c69df2cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:49.274259 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8bd4364f-a2d9-4f35-b9e6-9969c69df2cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:49.284437 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8bd4364f-a2d9-4f35-b9e6-9969c69df2cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:49.285873 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8bd4364f-a2d9-4f35-b9e6-9969c69df2cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:49.287050 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8bd4364f-a2d9-4f35-b9e6-9969c69df2cd tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.170274 Sep 11 01:01:49.287689 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 388/785] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:49 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:49.718161 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-7f4633cd-37d2-4445-82d8-7c5d5e689f8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:49.718805 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-7f4633cd-37d2-4445-82d8-7c5d5e689f8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:49.725819 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7f4633cd-37d2-4445-82d8-7c5d5e689f8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:49.727090 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7f4633cd-37d2-4445-82d8-7c5d5e689f8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:49.727753 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7f4633cd-37d2-4445-82d8-7c5d5e689f8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:49.728684 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7f4633cd-37d2-4445-82d8-7c5d5e689f8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:49.729133 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7f4633cd-37d2-4445-82d8-7c5d5e689f8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:49.729529 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7f4633cd-37d2-4445-82d8-7c5d5e689f8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:49.764742 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7f4633cd-37d2-4445-82d8-7c5d5e689f8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:49.765493 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7f4633cd-37d2-4445-82d8-7c5d5e689f8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:49.766087 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7f4633cd-37d2-4445-82d8-7c5d5e689f8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:49.766693 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-7f4633cd-37d2-4445-82d8-7c5d5e689f8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lazy-loading 'fault' on Instance uuid 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:01:49.809419 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-7f4633cd-37d2-4445-82d8-7c5d5e689f8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:49.817329 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-7f4633cd-37d2-4445-82d8-7c5d5e689f8f tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1331 microversion: 2.1 time: 0.103153 Sep 11 01:01:49.817907 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 398/786] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:49 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:49.828800 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-893c7a57-5b39-43e3-9d43-852d0848dd6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:49.829966 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-893c7a57-5b39-43e3-9d43-852d0848dd6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:49.836519 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-893c7a57-5b39-43e3-9d43-852d0848dd6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:49.837232 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-893c7a57-5b39-43e3-9d43-852d0848dd6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:49.837834 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-893c7a57-5b39-43e3-9d43-852d0848dd6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:49.838693 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-893c7a57-5b39-43e3-9d43-852d0848dd6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:49.839335 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-893c7a57-5b39-43e3-9d43-852d0848dd6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:49.839976 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-893c7a57-5b39-43e3-9d43-852d0848dd6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:49.922076 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f36a3fd3-9157-495d-a666-9f2eada2b3db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:49.923240 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f36a3fd3-9157-495d-a666-9f2eada2b3db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:49.930926 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f36a3fd3-9157-495d-a666-9f2eada2b3db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:49.931705 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f36a3fd3-9157-495d-a666-9f2eada2b3db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:49.932261 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f36a3fd3-9157-495d-a666-9f2eada2b3db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:49.933127 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f36a3fd3-9157-495d-a666-9f2eada2b3db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:49.933725 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f36a3fd3-9157-495d-a666-9f2eada2b3db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:49.934240 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f36a3fd3-9157-495d-a666-9f2eada2b3db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:49.959400 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:50.036061 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-893c7a57-5b39-43e3-9d43-852d0848dd6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] HTTP exception thrown: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-893c7a57-5b39-43e3-9d43-852d0848dd6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Request method failure captured: Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: DELETE /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca HTTP/1.1 Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIatU_rUWvJEnf3ctReKwprorKx05nzV7nHw_OTBlBxETZeTyg0kxFYPpH2M0OOy-RufMmUSzoemhw45mD_uk5B5djfJSdIUzm9kQyDdjZocylxf_hiWpEA5xgC1ECqaIe1lR_NGPkxp_hCmmlRWk4hGgZyQFRS9saXvJyyOTusGd4 Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 4dec451848364c2787673580ec4c90c1 Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:01:50.040511 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:01:50.042502 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4dec451848364c2787673580ec4c90c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4dec451848364c2787673580ec4c90c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4dec451848364c2787673580ec4c90c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4dec451848364c2787673580ec4c90c1", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:50.042502 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:50.042502 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 4dec451848364c2787673580ec4c90c1 Sep 11 01:01:50.042502 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:50.042502 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-AttachVolumeTestJSON-612483322-project Sep 11 01:01:50.042502 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:01:50.042502 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:01:50.042502 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 081d365c7b15443aa76c7da2ca444a8e Sep 11 01:01:50.042502 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeTestJSON-612483322-project Sep 11 01:01:50.042502 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:01:50.042502 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:50.042502 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': 'bb3eb557-558f-456d-83b2-23769926f3ca'} Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:50.043733 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:50.046145 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:50.049482 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-893c7a57-5b39-43e3-9d43-852d0848dd6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Returning 404 to user: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:50.050555 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-893c7a57-5b39-43e3-9d43-852d0848dd6b tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 404 len: 111 microversion: 2.1 time: 0.225883 Sep 11 01:01:50.051714 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 389/787] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:01:49 2022] DELETE /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 111 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:01:50.064927 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c59020d8-5c52-4be5-9676-b091ecf3877f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:50.065553 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c59020d8-5c52-4be5-9676-b091ecf3877f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: bb3eb557-558f-456d-83b2-23769926f3ca] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:50.082415 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c59020d8-5c52-4be5-9676-b091ecf3877f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:50.083353 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c59020d8-5c52-4be5-9676-b091ecf3877f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:50.084022 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c59020d8-5c52-4be5-9676-b091ecf3877f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:50.084996 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c59020d8-5c52-4be5-9676-b091ecf3877f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:50.085730 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c59020d8-5c52-4be5-9676-b091ecf3877f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:50.086366 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c59020d8-5c52-4be5-9676-b091ecf3877f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:50.105164 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-c59020d8-5c52-4be5-9676-b091ecf3877f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] HTTP exception thrown: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c59020d8-5c52-4be5-9676-b091ecf3877f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Request method failure captured: Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca HTTP/1.1 Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIatU_rUWvJEnf3ctReKwprorKx05nzV7nHw_OTBlBxETZeTyg0kxFYPpH2M0OOy-RufMmUSzoemhw45mD_uk5B5djfJSdIUzm9kQyDdjZocylxf_hiWpEA5xgC1ECqaIe1lR_NGPkxp_hCmmlRWk4hGgZyQFRS9saXvJyyOTusGd4 Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 4dec451848364c2787673580ec4c90c1 Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:01:50.107123 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:01:50.108868 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4dec451848364c2787673580ec4c90c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4dec451848364c2787673580ec4c90c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4dec451848364c2787673580ec4c90c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4dec451848364c2787673580ec4c90c1", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:50.108868 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:50.108868 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 4dec451848364c2787673580ec4c90c1 Sep 11 01:01:50.108868 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:50.108868 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-AttachVolumeTestJSON-612483322-project Sep 11 01:01:50.108868 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:01:50.108868 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:01:50.108868 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 081d365c7b15443aa76c7da2ca444a8e Sep 11 01:01:50.108868 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeTestJSON-612483322-project Sep 11 01:01:50.108868 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:01:50.108868 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:50.108868 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': 'bb3eb557-558f-456d-83b2-23769926f3ca'} Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:50.109876 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. Sep 11 01:01:50.112860 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:50.115637 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c59020d8-5c52-4be5-9676-b091ecf3877f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Returning 404 to user: Instance bb3eb557-558f-456d-83b2-23769926f3ca could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:50.116735 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c59020d8-5c52-4be5-9676-b091ecf3877f tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca" status: 404 len: 111 microversion: 2.1 time: 0.059395 Sep 11 01:01:50.117416 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 390/788] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:50 2022] GET /compute/v2.1/servers/bb3eb557-558f-456d-83b2-23769926f3ca => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:01:50.155097 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f36a3fd3-9157-495d-a666-9f2eada2b3db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:50.167369 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f36a3fd3-9157-495d-a666-9f2eada2b3db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.249930 Sep 11 01:01:50.168546 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 399/789] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:49 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:01:50.313923 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-20393433-c5bf-45e4-91cf-c235d85ca4ab tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:50.314579 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-20393433-c5bf-45e4-91cf-c235d85ca4ab tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:50.322814 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20393433-c5bf-45e4-91cf-c235d85ca4ab tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:50.323568 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20393433-c5bf-45e4-91cf-c235d85ca4ab tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:50.324188 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20393433-c5bf-45e4-91cf-c235d85ca4ab tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:50.325433 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20393433-c5bf-45e4-91cf-c235d85ca4ab tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:50.326526 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20393433-c5bf-45e4-91cf-c235d85ca4ab tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:50.327406 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20393433-c5bf-45e4-91cf-c235d85ca4ab tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:50.479453 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-20393433-c5bf-45e4-91cf-c235d85ca4ab tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:50.489062 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-20393433-c5bf-45e4-91cf-c235d85ca4ab tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:50.492989 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-20393433-c5bf-45e4-91cf-c235d85ca4ab tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:50.494203 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-20393433-c5bf-45e4-91cf-c235d85ca4ab tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.184992 Sep 11 01:01:50.494758 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 391/790] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:50 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:50.841130 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-1768675d-c6e9-4952-91bf-dae6442fab99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:50.842910 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-1768675d-c6e9-4952-91bf-dae6442fab99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:50.845902 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=2 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:50.852883 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1768675d-c6e9-4952-91bf-dae6442fab99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:50.853674 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1768675d-c6e9-4952-91bf-dae6442fab99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:50.854248 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1768675d-c6e9-4952-91bf-dae6442fab99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:50.855760 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1768675d-c6e9-4952-91bf-dae6442fab99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:50.856474 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1768675d-c6e9-4952-91bf-dae6442fab99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:50.857292 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1768675d-c6e9-4952-91bf-dae6442fab99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:50.861718 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=6 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:50.892497 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1768675d-c6e9-4952-91bf-dae6442fab99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:50.892967 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1768675d-c6e9-4952-91bf-dae6442fab99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:50.893391 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1768675d-c6e9-4952-91bf-dae6442fab99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:50.893824 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-1768675d-c6e9-4952-91bf-dae6442fab99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lazy-loading 'fault' on Instance uuid 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:01:50.935263 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1768675d-c6e9-4952-91bf-dae6442fab99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:50.943862 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-1768675d-c6e9-4952-91bf-dae6442fab99 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1331 microversion: 2.1 time: 0.107236 Sep 11 01:01:50.944637 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 400/791] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:50 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:51.190735 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7aa035b4-c1fa-4cbc-a7ed-d35f4d290b63 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:51.191576 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7aa035b4-c1fa-4cbc-a7ed-d35f4d290b63 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:51.193914 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:51.200068 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7aa035b4-c1fa-4cbc-a7ed-d35f4d290b63 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:51.200561 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7aa035b4-c1fa-4cbc-a7ed-d35f4d290b63 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:51.200988 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7aa035b4-c1fa-4cbc-a7ed-d35f4d290b63 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:51.201683 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7aa035b4-c1fa-4cbc-a7ed-d35f4d290b63 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:51.202123 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7aa035b4-c1fa-4cbc-a7ed-d35f4d290b63 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:51.202537 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7aa035b4-c1fa-4cbc-a7ed-d35f4d290b63 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:51.295162 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0afbe6b9-7c46-4e2e-a3fa-85b5bfab73e1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:51.295674 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-0afbe6b9-7c46-4e2e-a3fa-85b5bfab73e1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:51.301781 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0afbe6b9-7c46-4e2e-a3fa-85b5bfab73e1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:51.302311 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0afbe6b9-7c46-4e2e-a3fa-85b5bfab73e1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:51.307322 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0afbe6b9-7c46-4e2e-a3fa-85b5bfab73e1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:51.308199 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0afbe6b9-7c46-4e2e-a3fa-85b5bfab73e1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:51.308748 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0afbe6b9-7c46-4e2e-a3fa-85b5bfab73e1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:51.309116 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0afbe6b9-7c46-4e2e-a3fa-85b5bfab73e1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:51.327282 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-0afbe6b9-7c46-4e2e-a3fa-85b5bfab73e1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] HTTP exception thrown: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0afbe6b9-7c46-4e2e-a3fa-85b5bfab73e1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Request method failure captured: Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: DELETE /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 HTTP/1.1 Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTIatU_rUWvJEnf3ctReKwprorKx05nzV7nHw_OTBlBxETZeTyg0kxFYPpH2M0OOy-RufMmUSzoemhw45mD_uk5B5djfJSdIUzm9kQyDdjZocylxf_hiWpEA5xgC1ECqaIe1lR_NGPkxp_hCmmlRWk4hGgZyQFRS9saXvJyyOTusGd4 Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 4dec451848364c2787673580ec4c90c1 Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:01:51.329473 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:01:51.330947 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4dec451848364c2787673580ec4c90c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4dec451848364c2787673580ec4c90c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4dec451848364c2787673580ec4c90c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4dec451848364c2787673580ec4c90c1", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:51.330947 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:51.330947 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 4dec451848364c2787673580ec4c90c1 Sep 11 01:01:51.330947 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:51.330947 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-AttachVolumeTestJSON-612483322-project Sep 11 01:01:51.330947 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:01:51.330947 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:01:51.330947 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 081d365c7b15443aa76c7da2ca444a8e Sep 11 01:01:51.330947 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-AttachVolumeTestJSON-612483322-project Sep 11 01:01:51.330947 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 01:01:51.330947 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:01:51.330947 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': '11702158-2435-4d46-9e27-7ff56d83bca8'} Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:51.331779 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:01:51.333076 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:51.335859 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0afbe6b9-7c46-4e2e-a3fa-85b5bfab73e1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Returning 404 to user: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:51.336737 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0afbe6b9-7c46-4e2e-a3fa-85b5bfab73e1 tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "DELETE /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 404 len: 111 microversion: 2.1 time: 0.045554 Sep 11 01:01:51.337336 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 401/792] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:01:51 2022] DELETE /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 01:01:51.345325 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d7310691-d7fa-40f1-af63-23bb0099814c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:51.346346 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d7310691-d7fa-40f1-af63-23bb0099814c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] [instance: 11702158-2435-4d46-9e27-7ff56d83bca8] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:51.352705 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d7310691-d7fa-40f1-af63-23bb0099814c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:51.355691 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d7310691-d7fa-40f1-af63-23bb0099814c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:51.356254 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d7310691-d7fa-40f1-af63-23bb0099814c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:51.357401 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d7310691-d7fa-40f1-af63-23bb0099814c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:51.358100 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d7310691-d7fa-40f1-af63-23bb0099814c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:51.358663 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d7310691-d7fa-40f1-af63-23bb0099814c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:51.364710 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-7aa035b4-c1fa-4cbc-a7ed-d35f4d290b63 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:51.375653 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-d7310691-d7fa-40f1-af63-23bb0099814c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] HTTP exception thrown: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d7310691-d7fa-40f1-af63-23bb0099814c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Request method failure captured: Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 HTTP/1.1 Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTIatU_rUWvJEnf3ctReKwprorKx05nzV7nHw_OTBlBxETZeTyg0kxFYPpH2M0OOy-RufMmUSzoemhw45mD_uk5B5djfJSdIUzm9kQyDdjZocylxf_hiWpEA5xgC1ECqaIe1lR_NGPkxp_hCmmlRWk4hGgZyQFRS9saXvJyyOTusGd4 Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 4dec451848364c2787673580ec4c90c1 Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:01:51.377412 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:01:51.378816 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4dec451848364c2787673580ec4c90c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4dec451848364c2787673580ec4c90c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4dec451848364c2787673580ec4c90c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4dec451848364c2787673580ec4c90c1", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:51.378816 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:51.378816 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 4dec451848364c2787673580ec4c90c1 Sep 11 01:01:51.378816 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-AttachVolumeTestJSON-612483322 Sep 11 01:01:51.378816 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-AttachVolumeTestJSON-612483322-project Sep 11 01:01:51.378816 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:01:51.378816 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:01:51.378816 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 081d365c7b15443aa76c7da2ca444a8e Sep 11 01:01:51.378816 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-AttachVolumeTestJSON-612483322-project Sep 11 01:01:51.378816 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 01:01:51.378816 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:01:51.378816 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': '11702158-2435-4d46-9e27-7ff56d83bca8'} Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:51.379661 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. Sep 11 01:01:51.380849 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:51.381944 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d7310691-d7fa-40f1-af63-23bb0099814c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] Returning 404 to user: Instance 11702158-2435-4d46-9e27-7ff56d83bca8 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:51.381944 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d7310691-d7fa-40f1-af63-23bb0099814c tempest-AttachVolumeTestJSON-612483322 tempest-AttachVolumeTestJSON-612483322-project] 10.222.0.23 "GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8" status: 404 len: 111 microversion: 2.1 time: 0.037375 Sep 11 01:01:51.381944 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 402/793] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:51 2022] GET /compute/v2.1/servers/11702158-2435-4d46-9e27-7ff56d83bca8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 01:01:51.383849 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7aa035b4-c1fa-4cbc-a7ed-d35f4d290b63 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.197023 Sep 11 01:01:51.384443 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 392/794] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:51 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:51.523638 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3c8d85ac-f225-44c0-b8e7-fe1d41d9c3fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:51.524242 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3c8d85ac-f225-44c0-b8e7-fe1d41d9c3fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:51.530267 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:51.532074 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c8d85ac-f225-44c0-b8e7-fe1d41d9c3fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:51.532562 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c8d85ac-f225-44c0-b8e7-fe1d41d9c3fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:51.533032 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c8d85ac-f225-44c0-b8e7-fe1d41d9c3fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:51.533784 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c8d85ac-f225-44c0-b8e7-fe1d41d9c3fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:51.534553 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c8d85ac-f225-44c0-b8e7-fe1d41d9c3fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:51.535109 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3c8d85ac-f225-44c0-b8e7-fe1d41d9c3fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:51.757068 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3c8d85ac-f225-44c0-b8e7-fe1d41d9c3fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:51.768972 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3c8d85ac-f225-44c0-b8e7-fe1d41d9c3fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:51.770636 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3c8d85ac-f225-44c0-b8e7-fe1d41d9c3fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:51.771985 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3c8d85ac-f225-44c0-b8e7-fe1d41d9c3fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.252198 Sep 11 01:01:51.773078 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 403/795] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:51 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:51.966067 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3dbfbb8a-fcb8-4d1f-abb3-901c782615d5 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:51.966664 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3dbfbb8a-fcb8-4d1f-abb3-901c782615d5 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:51.972883 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3dbfbb8a-fcb8-4d1f-abb3-901c782615d5 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:51.973386 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3dbfbb8a-fcb8-4d1f-abb3-901c782615d5 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:51.973882 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3dbfbb8a-fcb8-4d1f-abb3-901c782615d5 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:51.974587 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3dbfbb8a-fcb8-4d1f-abb3-901c782615d5 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:51.975032 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3dbfbb8a-fcb8-4d1f-abb3-901c782615d5 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:51.975510 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3dbfbb8a-fcb8-4d1f-abb3-901c782615d5 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:52.010433 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3dbfbb8a-fcb8-4d1f-abb3-901c782615d5 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:52.011273 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3dbfbb8a-fcb8-4d1f-abb3-901c782615d5 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:52.011963 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3dbfbb8a-fcb8-4d1f-abb3-901c782615d5 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:52.012625 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-3dbfbb8a-fcb8-4d1f-abb3-901c782615d5 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lazy-loading 'fault' on Instance uuid 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:01:52.019143 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:52.077440 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3dbfbb8a-fcb8-4d1f-abb3-901c782615d5 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:52.087627 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3dbfbb8a-fcb8-4d1f-abb3-901c782615d5 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1331 microversion: 2.1 time: 0.125478 Sep 11 01:01:52.088639 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 393/796] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:51 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:52.412535 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-cbff7cc4-2723-43f6-9951-54307ccf45c9 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:52.413634 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-cbff7cc4-2723-43f6-9951-54307ccf45c9 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:52.421172 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cbff7cc4-2723-43f6-9951-54307ccf45c9 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:52.421656 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cbff7cc4-2723-43f6-9951-54307ccf45c9 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:52.422093 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cbff7cc4-2723-43f6-9951-54307ccf45c9 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:52.422801 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cbff7cc4-2723-43f6-9951-54307ccf45c9 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:52.423274 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cbff7cc4-2723-43f6-9951-54307ccf45c9 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:52.423715 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-cbff7cc4-2723-43f6-9951-54307ccf45c9 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:52.749897 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-cbff7cc4-2723-43f6-9951-54307ccf45c9 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:52.765600 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-cbff7cc4-2723-43f6-9951-54307ccf45c9 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.357150 Sep 11 01:01:52.771167 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 404/797] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:52 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:52.799025 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c2abc10d-9bae-43b1-81c4-2f4d141b9a31 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:52.799666 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c2abc10d-9bae-43b1-81c4-2f4d141b9a31 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:52.806838 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2abc10d-9bae-43b1-81c4-2f4d141b9a31 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:52.807595 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2abc10d-9bae-43b1-81c4-2f4d141b9a31 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:52.808178 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2abc10d-9bae-43b1-81c4-2f4d141b9a31 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:52.809039 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2abc10d-9bae-43b1-81c4-2f4d141b9a31 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:52.810046 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2abc10d-9bae-43b1-81c4-2f4d141b9a31 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:52.810531 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2abc10d-9bae-43b1-81c4-2f4d141b9a31 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:53.026112 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c2abc10d-9bae-43b1-81c4-2f4d141b9a31 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:53.035377 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c2abc10d-9bae-43b1-81c4-2f4d141b9a31 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:53.037079 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c2abc10d-9bae-43b1-81c4-2f4d141b9a31 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:53.038885 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c2abc10d-9bae-43b1-81c4-2f4d141b9a31 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.244054 Sep 11 01:01:53.050401 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 394/798] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:52 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:53.110413 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a1b24450-8225-4cd3-894f-f57768f85e0b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:53.111026 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a1b24450-8225-4cd3-894f-f57768f85e0b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:53.118092 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1b24450-8225-4cd3-894f-f57768f85e0b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:53.118772 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1b24450-8225-4cd3-894f-f57768f85e0b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:53.119016 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1b24450-8225-4cd3-894f-f57768f85e0b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:53.119758 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1b24450-8225-4cd3-894f-f57768f85e0b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:53.120217 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1b24450-8225-4cd3-894f-f57768f85e0b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:53.120633 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1b24450-8225-4cd3-894f-f57768f85e0b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:53.180122 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1b24450-8225-4cd3-894f-f57768f85e0b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:53.180612 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1b24450-8225-4cd3-894f-f57768f85e0b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:53.181043 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a1b24450-8225-4cd3-894f-f57768f85e0b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:53.181492 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-a1b24450-8225-4cd3-894f-f57768f85e0b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lazy-loading 'fault' on Instance uuid 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:01:53.237627 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a1b24450-8225-4cd3-894f-f57768f85e0b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:53.249841 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a1b24450-8225-4cd3-894f-f57768f85e0b tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1331 microversion: 2.1 time: 0.143539 Sep 11 01:01:53.251538 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 405/799] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:53 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1331 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:53.793256 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1630dfa7-b794-49b9-bc9f-0cfa34027047 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:53.793982 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1630dfa7-b794-49b9-bc9f-0cfa34027047 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:53.800765 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1630dfa7-b794-49b9-bc9f-0cfa34027047 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:53.802140 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1630dfa7-b794-49b9-bc9f-0cfa34027047 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:53.802798 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1630dfa7-b794-49b9-bc9f-0cfa34027047 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:53.803805 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1630dfa7-b794-49b9-bc9f-0cfa34027047 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:53.804486 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1630dfa7-b794-49b9-bc9f-0cfa34027047 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:53.805152 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1630dfa7-b794-49b9-bc9f-0cfa34027047 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:54.000404 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1630dfa7-b794-49b9-bc9f-0cfa34027047 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:54.010498 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1630dfa7-b794-49b9-bc9f-0cfa34027047 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.221136 Sep 11 01:01:54.011986 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 395/800] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:53 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:54.066329 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6452d623-3881-4a90-a9a5-84c1d627ffbb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:54.066972 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6452d623-3881-4a90-a9a5-84c1d627ffbb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:54.073967 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6452d623-3881-4a90-a9a5-84c1d627ffbb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:54.074586 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6452d623-3881-4a90-a9a5-84c1d627ffbb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:54.075028 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6452d623-3881-4a90-a9a5-84c1d627ffbb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:54.075767 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6452d623-3881-4a90-a9a5-84c1d627ffbb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:54.076222 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6452d623-3881-4a90-a9a5-84c1d627ffbb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:54.076634 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6452d623-3881-4a90-a9a5-84c1d627ffbb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:54.270157 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6452d623-3881-4a90-a9a5-84c1d627ffbb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:54.274669 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c1c41e63-60a3-48be-badb-e35ba559f612 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:54.275436 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c1c41e63-60a3-48be-badb-e35ba559f612 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:54.284092 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6452d623-3881-4a90-a9a5-84c1d627ffbb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:54.284934 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c41e63-60a3-48be-badb-e35ba559f612 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:54.285521 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c41e63-60a3-48be-badb-e35ba559f612 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:54.286026 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c41e63-60a3-48be-badb-e35ba559f612 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:54.286816 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c41e63-60a3-48be-badb-e35ba559f612 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:54.287512 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c41e63-60a3-48be-badb-e35ba559f612 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:54.288618 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c41e63-60a3-48be-badb-e35ba559f612 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:54.290124 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6452d623-3881-4a90-a9a5-84c1d627ffbb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:54.294347 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6452d623-3881-4a90-a9a5-84c1d627ffbb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.232214 Sep 11 01:01:54.295123 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 406/801] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:54 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:54.336945 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c41e63-60a3-48be-badb-e35ba559f612 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:54.337433 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c41e63-60a3-48be-badb-e35ba559f612 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:54.337863 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c41e63-60a3-48be-badb-e35ba559f612 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:54.338307 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-c1c41e63-60a3-48be-badb-e35ba559f612 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lazy-loading 'fault' on Instance uuid 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:01:54.384794 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c1c41e63-60a3-48be-badb-e35ba559f612 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:54.392915 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c1c41e63-60a3-48be-badb-e35ba559f612 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1331 microversion: 2.1 time: 0.123149 Sep 11 01:01:54.393720 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 396/802] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:54 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:01:55.034057 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-1ff53ada-f3ec-4bd5-bad3-6f0a2c78a6de tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:55.034687 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-1ff53ada-f3ec-4bd5-bad3-6f0a2c78a6de tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:55.041642 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1ff53ada-f3ec-4bd5-bad3-6f0a2c78a6de tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:55.042139 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1ff53ada-f3ec-4bd5-bad3-6f0a2c78a6de tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:55.042570 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1ff53ada-f3ec-4bd5-bad3-6f0a2c78a6de tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:55.043381 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1ff53ada-f3ec-4bd5-bad3-6f0a2c78a6de tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:55.043832 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1ff53ada-f3ec-4bd5-bad3-6f0a2c78a6de tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:55.044250 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1ff53ada-f3ec-4bd5-bad3-6f0a2c78a6de tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:55.184292 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1ff53ada-f3ec-4bd5-bad3-6f0a2c78a6de tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:55.192967 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-1ff53ada-f3ec-4bd5-bad3-6f0a2c78a6de tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.162784 Sep 11 01:01:55.193560 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 407/803] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:55 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:55.320034 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-932a7a5f-ad7b-4145-8c01-bf07d69d556d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:55.320954 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-932a7a5f-ad7b-4145-8c01-bf07d69d556d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:55.327803 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-932a7a5f-ad7b-4145-8c01-bf07d69d556d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:55.328368 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-932a7a5f-ad7b-4145-8c01-bf07d69d556d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:55.328871 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-932a7a5f-ad7b-4145-8c01-bf07d69d556d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:55.329781 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-932a7a5f-ad7b-4145-8c01-bf07d69d556d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:55.330322 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-932a7a5f-ad7b-4145-8c01-bf07d69d556d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:55.330870 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-932a7a5f-ad7b-4145-8c01-bf07d69d556d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:55.417370 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-fd471c11-5f22-4017-96d2-dca181c6f03c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:55.418022 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-fd471c11-5f22-4017-96d2-dca181c6f03c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:55.436724 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fd471c11-5f22-4017-96d2-dca181c6f03c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:55.437467 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fd471c11-5f22-4017-96d2-dca181c6f03c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:55.437970 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fd471c11-5f22-4017-96d2-dca181c6f03c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:55.438739 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fd471c11-5f22-4017-96d2-dca181c6f03c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:55.439368 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fd471c11-5f22-4017-96d2-dca181c6f03c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:55.439849 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fd471c11-5f22-4017-96d2-dca181c6f03c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:55.472877 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fd471c11-5f22-4017-96d2-dca181c6f03c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:55.473452 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fd471c11-5f22-4017-96d2-dca181c6f03c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:55.474110 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-fd471c11-5f22-4017-96d2-dca181c6f03c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:55.474616 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-fd471c11-5f22-4017-96d2-dca181c6f03c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lazy-loading 'fault' on Instance uuid 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:01:55.479400 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-932a7a5f-ad7b-4145-8c01-bf07d69d556d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:55.488614 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-932a7a5f-ad7b-4145-8c01-bf07d69d556d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:55.489875 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-932a7a5f-ad7b-4145-8c01-bf07d69d556d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:55.491168 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-932a7a5f-ad7b-4145-8c01-bf07d69d556d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.175299 Sep 11 01:01:55.492080 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 397/804] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:55 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:55.516866 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-fd471c11-5f22-4017-96d2-dca181c6f03c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364cf4a7a3bf4e70973c78a5d690e998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e6e6a587374d53b8515f264dfd8cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:55.524579 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-fd471c11-5f22-4017-96d2-dca181c6f03c tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 200 len: 1331 microversion: 2.1 time: 0.111494 Sep 11 01:01:55.525108 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 408/805] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:55 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:56.216457 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e7a92ac9-90ae-4454-b4d5-dd9348150c73 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:56.217307 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e7a92ac9-90ae-4454-b4d5-dd9348150c73 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:56.224136 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7a92ac9-90ae-4454-b4d5-dd9348150c73 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:56.224703 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7a92ac9-90ae-4454-b4d5-dd9348150c73 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:56.225151 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7a92ac9-90ae-4454-b4d5-dd9348150c73 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:56.231191 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7a92ac9-90ae-4454-b4d5-dd9348150c73 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:56.231738 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7a92ac9-90ae-4454-b4d5-dd9348150c73 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:56.232204 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7a92ac9-90ae-4454-b4d5-dd9348150c73 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:56.453275 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e7a92ac9-90ae-4454-b4d5-dd9348150c73 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:56.461855 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e7a92ac9-90ae-4454-b4d5-dd9348150c73 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.249996 Sep 11 01:01:56.462437 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 398/806] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:56 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:56.516696 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a29b50c2-de7d-4aea-96de-33ed65c9dc30 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:56.517446 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a29b50c2-de7d-4aea-96de-33ed65c9dc30 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:56.524258 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a29b50c2-de7d-4aea-96de-33ed65c9dc30 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:56.524700 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a29b50c2-de7d-4aea-96de-33ed65c9dc30 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:56.525233 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a29b50c2-de7d-4aea-96de-33ed65c9dc30 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:56.525941 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a29b50c2-de7d-4aea-96de-33ed65c9dc30 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:56.526627 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a29b50c2-de7d-4aea-96de-33ed65c9dc30 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:56.527050 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a29b50c2-de7d-4aea-96de-33ed65c9dc30 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:56.549570 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-66f040b5-3709-45b6-9bd1-665b7a41abe7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:56.550915 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-66f040b5-3709-45b6-9bd1-665b7a41abe7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:56.557688 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66f040b5-3709-45b6-9bd1-665b7a41abe7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:56.562633 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66f040b5-3709-45b6-9bd1-665b7a41abe7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:56.563133 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66f040b5-3709-45b6-9bd1-665b7a41abe7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:56.563889 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66f040b5-3709-45b6-9bd1-665b7a41abe7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:56.564480 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66f040b5-3709-45b6-9bd1-665b7a41abe7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:56.564911 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66f040b5-3709-45b6-9bd1-665b7a41abe7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:56.602055 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-66f040b5-3709-45b6-9bd1-665b7a41abe7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] HTTP exception thrown: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-66f040b5-3709-45b6-9bd1-665b7a41abe7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Request method failure captured: Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff HTTP/1.1 Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIZleOaEuAlKtiWOzScZQy__ERdzmN_Fsh18R3AG3G89WR_08snWZ6YRxuVmBkd8e4eDOuVoSFmU4H1_ArYPdT3bBFelG_bNniDYHGShKUr5tzXt-fC8Pp-PdXsUGSAqFcgcXiUSGpT-d-6G18Ajvb77CCwyMx9RJWxLsZjcUQaDz8 Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:01:56.604773 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:01:56.606527 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89e6e6a587374d53b8515f264dfd8cb6", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:56.606527 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:01:56.606527 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:01:56.606527 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:01:56.606527 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:01:56.606527 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:01:56.606527 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:01:56.606527 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 364cf4a7a3bf4e70973c78a5d690e998 Sep 11 01:01:56.606527 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:01:56.606527 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:01:56.606527 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:56.606527 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': '2bf3c5f1-9b78-4721-97e4-170c26cbf0ff'} Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:56.607429 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:56.608731 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:56.609931 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-66f040b5-3709-45b6-9bd1-665b7a41abe7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Returning 404 to user: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:56.609931 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-66f040b5-3709-45b6-9bd1-665b7a41abe7 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 404 len: 111 microversion: 2.1 time: 0.062275 Sep 11 01:01:56.609931 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 399/807] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:56 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:01:56.615630 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1bc9fbdc-336f-4f98-af7b-7828f9881544 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '.version_select at 0x7fbb905e1700>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:56.640507 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1bc9fbdc-336f-4f98-af7b-7828f9881544 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1008429077" status: 202 len: 0 microversion: 2.1 time: 0.028456 Sep 11 01:01:56.641100 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 400/808] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Sep 11 01:01:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1008429077 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:01:56.706215 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a29b50c2-de7d-4aea-96de-33ed65c9dc30 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:56.715156 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a29b50c2-de7d-4aea-96de-33ed65c9dc30 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:56.716656 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a29b50c2-de7d-4aea-96de-33ed65c9dc30 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:56.717944 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a29b50c2-de7d-4aea-96de-33ed65c9dc30 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.205124 Sep 11 01:01:56.718377 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 409/809] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:56 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 01:01:57.326211 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2657cf17-6460-41c6-9744-dc81045bf207 tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Action: 'create', calling method: .version_select at 0x7fbb905f3dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1545647791", "metadata": {"Type": "work"}}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2657cf17-6460-41c6-9744-dc81045bf207 tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Request method failure captured: Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 122 Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTOF4fxBCSX8TNxMeEGO9V-a2m_2tkU25gQTuXLgUu0n_NqWam85UXasAjrfKJzTDxnCE3jMQecaMBE5zZay0Ujp0DSp2NDFHjUzo9VVVKiIPBdouTQU_QS0nnDTgU8Rzi42wu_gsLvCtQ-HSAxv9LdWAJTE-6GTdA_4lALryt_2s60 Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 5fb9f54b53244122859ad3caf974596e Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:01:57.345089 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:01:57.346764 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5fb9f54b53244122859ad3caf974596e", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:57.346764 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.346764 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 5fb9f54b53244122859ad3caf974596e Sep 11 01:01:57.346764 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.346764 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-VolumesNegativeTest-642600809-project Sep 11 01:01:57.346764 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:01:57.346764 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:01:57.346764 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: d078b719015d43ce9143ccb3e7870615 Sep 11 01:01:57.346764 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-VolumesNegativeTest-642600809-project Sep 11 01:01:57.346764 dv-cinder-master-3-smb devstack@n-api.service[120496]: Sep 11 01:01:57.346764 dv-cinder-master-3-smb devstack@n-api.service[120496]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1545647791", "metadata": {"Type": "work"}}} Sep 11 01:01:57.346764 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: Sep 11 01:01:57.346764 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1545647791', 'metadata': {'Type': 'work'}}}} Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise error Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi '#$%' Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:57.347867 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 01:01:57.349481 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 01:01:57.351164 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 01:01:57.351164 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.352768 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2657cf17-6460-41c6-9744-dc81045bf207 tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:57.353708 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2657cf17-6460-41c6-9744-dc81045bf207 tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.170501 Sep 11 01:01:57.354632 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 401/810] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Sep 11 01:01:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 01:01:57.377891 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e93290c2-ebc1-438e-89d6-77b6300a6443 tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Action: 'create', calling method: .version_select at 0x7fbb90529040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-995002931", "metadata": {"Type": "work"}}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e93290c2-ebc1-438e-89d6-77b6300a6443 tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Request method failure captured: Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 119 Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTOF4fxBCSX8TNxMeEGO9V-a2m_2tkU25gQTuXLgUu0n_NqWam85UXasAjrfKJzTDxnCE3jMQecaMBE5zZay0Ujp0DSp2NDFHjUzo9VVVKiIPBdouTQU_QS0nnDTgU8Rzi42wu_gsLvCtQ-HSAxv9LdWAJTE-6GTdA_4lALryt_2s60 Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 5fb9f54b53244122859ad3caf974596e Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:01:57.383601 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:01:57.385263 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5fb9f54b53244122859ad3caf974596e", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:57.385263 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.385263 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 5fb9f54b53244122859ad3caf974596e Sep 11 01:01:57.385263 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.385263 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-VolumesNegativeTest-642600809-project Sep 11 01:01:57.385263 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:01:57.385263 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:01:57.385263 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: d078b719015d43ce9143ccb3e7870615 Sep 11 01:01:57.385263 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-VolumesNegativeTest-642600809-project Sep 11 01:01:57.385263 dv-cinder-master-3-smb devstack@n-api.service[120497]: Sep 11 01:01:57.385263 dv-cinder-master-3-smb devstack@n-api.service[120497]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-995002931", "metadata": {"Type": "work"}}} Sep 11 01:01:57.385263 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: Sep 11 01:01:57.385263 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-995002931', 'metadata': {'Type': 'work'}}}} Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise error Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi '0' Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:57.386218 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 01:01:57.387937 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 01:01:57.389423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 01:01:57.389423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.390431 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e93290c2-ebc1-438e-89d6-77b6300a6443 tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:57.391320 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-e93290c2-ebc1-438e-89d6-77b6300a6443 tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019499 Sep 11 01:01:57.392058 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 410/811] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Sep 11 01:01:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 01:01:57.407755 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3a9869e1-3c86-41c9-95d1-7ed0df231bb2 tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Action: 'create', calling method: .version_select at 0x7fbb905f30d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1192047882", "metadata": {"Type": "work"}}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3a9869e1-3c86-41c9-95d1-7ed0df231bb2 tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Request method failure captured: Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 119 Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTOF4fxBCSX8TNxMeEGO9V-a2m_2tkU25gQTuXLgUu0n_NqWam85UXasAjrfKJzTDxnCE3jMQecaMBE5zZay0Ujp0DSp2NDFHjUzo9VVVKiIPBdouTQU_QS0nnDTgU8Rzi42wu_gsLvCtQ-HSAxv9LdWAJTE-6GTdA_4lALryt_2s60 Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 5fb9f54b53244122859ad3caf974596e Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:01:57.413331 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:01:57.414834 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5fb9f54b53244122859ad3caf974596e", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:57.414834 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.414834 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 5fb9f54b53244122859ad3caf974596e Sep 11 01:01:57.414834 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.414834 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-VolumesNegativeTest-642600809-project Sep 11 01:01:57.414834 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:01:57.414834 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:01:57.414834 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: d078b719015d43ce9143ccb3e7870615 Sep 11 01:01:57.414834 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-VolumesNegativeTest-642600809-project Sep 11 01:01:57.414834 dv-cinder-master-3-smb devstack@n-api.service[120496]: Sep 11 01:01:57.414834 dv-cinder-master-3-smb devstack@n-api.service[120496]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1192047882", "metadata": {"Type": "work"}}} Sep 11 01:01:57.414834 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: Sep 11 01:01:57.414834 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1192047882', 'metadata': {'Type': 'work'}}}} Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise error Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi '' Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:57.415704 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 01:01:57.417050 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 01:01:57.418316 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 01:01:57.418316 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.420722 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3a9869e1-3c86-41c9-95d1-7ed0df231bb2 tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:57.421856 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3a9869e1-3c86-41c9-95d1-7ed0df231bb2 tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024206 Sep 11 01:01:57.423157 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 402/812] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Sep 11 01:01:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 01:01:57.433239 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-79a880de-6c69-480e-9235-ce8d60a535ae tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Calling method '.version_select at 0x7fbb90575550>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:57.466936 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-79a880de-6c69-480e-9235-ce8d60a535ae tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] HTTP exception thrown: Volume tempest-invalid-1873978155 could not be found. Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-79a880de-6c69-480e-9235-ce8d60a535ae tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Request method failure captured: Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1873978155 HTTP/1.1 Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTOF4fxBCSX8TNxMeEGO9V-a2m_2tkU25gQTuXLgUu0n_NqWam85UXasAjrfKJzTDxnCE3jMQecaMBE5zZay0Ujp0DSp2NDFHjUzo9VVVKiIPBdouTQU_QS0nnDTgU8Rzi42wu_gsLvCtQ-HSAxv9LdWAJTE-6GTdA_4lALryt_2s60 Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 5fb9f54b53244122859ad3caf974596e Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:01:57.469233 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:01:57.470877 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5fb9f54b53244122859ad3caf974596e", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:57.470877 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.470877 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 5fb9f54b53244122859ad3caf974596e Sep 11 01:01:57.470877 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.470877 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-VolumesNegativeTest-642600809-project Sep 11 01:01:57.470877 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:01:57.470877 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:01:57.470877 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: d078b719015d43ce9143ccb3e7870615 Sep 11 01:01:57.470877 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-VolumesNegativeTest-642600809-project Sep 11 01:01:57.470877 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: Sep 11 01:01:57.470877 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Volume tempest-invalid-1873978155 could not be found. Sep 11 01:01:57.470877 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': 'tempest-invalid-1873978155'} Sep 11 01:01:57.470877 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1873978155 could not be found. (HTTP 404) (Request-ID: req-ac09fda3-f3cc-45c6-94b6-ced9a467e7cf) Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.472394 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 01:01:57.473910 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1873978155 could not be found. Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:01:57.475675 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1873978155 could not be found. Sep 11 01:01:57.477129 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.477129 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.477129 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.477129 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.477129 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:57.477129 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:57.477129 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:01:57.477129 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:01:57.477129 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1873978155 could not be found. Sep 11 01:01:57.477129 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.478517 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-79a880de-6c69-480e-9235-ce8d60a535ae tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Returning 404 to user: Volume tempest-invalid-1873978155 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:57.479682 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-79a880de-6c69-480e-9235-ce8d60a535ae tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1873978155" status: 404 len: 99 microversion: 2.1 time: 0.050941 Sep 11 01:01:57.483209 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 411/813] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Sep 11 01:01:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1873978155 => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 11 01:01:57.485601 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aad6ddf8-5336-4d9b-b6a0-4e79d90122e7 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:57.487219 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-aad6ddf8-5336-4d9b-b6a0-4e79d90122e7 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:57.490528 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-b490681f-7e14-477b-860c-73128603de82 tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005011 Sep 11 01:01:57.491058 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 412/814] 10.222.0.23 () {58 vars in 1140 bytes} [Sun Sep 11 01:01:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 11 01:01:57.494743 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aad6ddf8-5336-4d9b-b6a0-4e79d90122e7 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:57.495465 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aad6ddf8-5336-4d9b-b6a0-4e79d90122e7 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:57.496347 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aad6ddf8-5336-4d9b-b6a0-4e79d90122e7 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:57.497933 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aad6ddf8-5336-4d9b-b6a0-4e79d90122e7 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:57.498698 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aad6ddf8-5336-4d9b-b6a0-4e79d90122e7 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:57.499312 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aad6ddf8-5336-4d9b-b6a0-4e79d90122e7 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:57.501296 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c2a0c5ea-27e7-4eaa-92a2-ff3ed7aeaf01 tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004607 Sep 11 01:01:57.502288 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 413/815] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Sep 11 01:01:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 11 01:01:57.514543 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-65b4876f-f03e-43c4-9f4e-8da83323cd7b tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Calling method '.version_select at 0x7fbb90529d30>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:57.562763 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-65b4876f-f03e-43c4-9f4e-8da83323cd7b tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] HTTP exception thrown: Volume aff2e613-f427-417f-96a1-86b0a5d89cc0 could not be found. Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-65b4876f-f03e-43c4-9f4e-8da83323cd7b tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Request method failure captured: Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: DELETE /compute/v2.1/os-volumes/aff2e613-f427-417f-96a1-86b0a5d89cc0 HTTP/1.1 Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTOF4fxBCSX8TNxMeEGO9V-a2m_2tkU25gQTuXLgUu0n_NqWam85UXasAjrfKJzTDxnCE3jMQecaMBE5zZay0Ujp0DSp2NDFHjUzo9VVVKiIPBdouTQU_QS0nnDTgU8Rzi42wu_gsLvCtQ-HSAxv9LdWAJTE-6GTdA_4lALryt_2s60 Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 5fb9f54b53244122859ad3caf974596e Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:01:57.565394 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:01:57.567103 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5fb9f54b53244122859ad3caf974596e", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:57.567103 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.567103 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 5fb9f54b53244122859ad3caf974596e Sep 11 01:01:57.567103 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.567103 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-VolumesNegativeTest-642600809-project Sep 11 01:01:57.567103 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:01:57.567103 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:01:57.567103 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: d078b719015d43ce9143ccb3e7870615 Sep 11 01:01:57.567103 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-VolumesNegativeTest-642600809-project Sep 11 01:01:57.567103 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: Sep 11 01:01:57.567103 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Volume aff2e613-f427-417f-96a1-86b0a5d89cc0 could not be found. Sep 11 01:01:57.567103 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': 'aff2e613-f427-417f-96a1-86b0a5d89cc0'} Sep 11 01:01:57.567103 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aff2e613-f427-417f-96a1-86b0a5d89cc0 could not be found. (HTTP 404) (Request-ID: req-446eb042-7600-40df-b1d6-a154cb45a05a) Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.568105 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 01:01:57.569833 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aff2e613-f427-417f-96a1-86b0a5d89cc0 could not be found. Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 01:01:57.571759 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:01:57.573037 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aff2e613-f427-417f-96a1-86b0a5d89cc0 could not be found. Sep 11 01:01:57.573037 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.573037 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.573037 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.573037 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.573037 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:57.573037 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:57.573037 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:01:57.573037 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:01:57.573037 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aff2e613-f427-417f-96a1-86b0a5d89cc0 could not be found. Sep 11 01:01:57.573037 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.573037 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-65b4876f-f03e-43c4-9f4e-8da83323cd7b tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Returning 404 to user: Volume aff2e613-f427-417f-96a1-86b0a5d89cc0 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:57.573037 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-65b4876f-f03e-43c4-9f4e-8da83323cd7b tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/aff2e613-f427-417f-96a1-86b0a5d89cc0" status: 404 len: 109 microversion: 2.1 time: 0.056971 Sep 11 01:01:57.573037 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 414/816] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Sep 11 01:01:57 2022] DELETE /compute/v2.1/os-volumes/aff2e613-f427-417f-96a1-86b0a5d89cc0 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 01:01:57.581415 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b5d1d2ab-9220-4827-936f-5e989ef4b85b tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Calling method '.version_select at 0x7fbb90529ca0>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:57.617063 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-b5d1d2ab-9220-4827-936f-5e989ef4b85b tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] HTTP exception thrown: Volume 37808c6e-c3f6-41e4-b16c-ea09d198e531 could not be found. Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b5d1d2ab-9220-4827-936f-5e989ef4b85b tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Request method failure captured: Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/os-volumes/37808c6e-c3f6-41e4-b16c-ea09d198e531 HTTP/1.1 Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTOF4fxBCSX8TNxMeEGO9V-a2m_2tkU25gQTuXLgUu0n_NqWam85UXasAjrfKJzTDxnCE3jMQecaMBE5zZay0Ujp0DSp2NDFHjUzo9VVVKiIPBdouTQU_QS0nnDTgU8Rzi42wu_gsLvCtQ-HSAxv9LdWAJTE-6GTdA_4lALryt_2s60 Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 5fb9f54b53244122859ad3caf974596e Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:01:57.619024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:01:57.620746 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5fb9f54b53244122859ad3caf974596e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5fb9f54b53244122859ad3caf974596e", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:57.620746 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.620746 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 5fb9f54b53244122859ad3caf974596e Sep 11 01:01:57.620746 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-VolumesNegativeTest-642600809 Sep 11 01:01:57.620746 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-VolumesNegativeTest-642600809-project Sep 11 01:01:57.620746 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:01:57.620746 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:01:57.620746 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: d078b719015d43ce9143ccb3e7870615 Sep 11 01:01:57.620746 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-VolumesNegativeTest-642600809-project Sep 11 01:01:57.620746 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: Sep 11 01:01:57.620746 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Volume 37808c6e-c3f6-41e4-b16c-ea09d198e531 could not be found. Sep 11 01:01:57.620746 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': '37808c6e-c3f6-41e4-b16c-ea09d198e531'} Sep 11 01:01:57.620746 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37808c6e-c3f6-41e4-b16c-ea09d198e531 could not be found. (HTTP 404) (Request-ID: req-790e18db-3262-4e0b-a734-15d313803154) Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.622665 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 01:01:57.623915 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37808c6e-c3f6-41e4-b16c-ea09d198e531 could not be found. Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 01:01:57.625618 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:01:57.626899 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37808c6e-c3f6-41e4-b16c-ea09d198e531 could not be found. Sep 11 01:01:57.626899 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.626899 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:57.626899 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.626899 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:57.626899 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:57.626899 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:57.626899 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:01:57.626899 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:01:57.626899 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37808c6e-c3f6-41e4-b16c-ea09d198e531 could not be found. Sep 11 01:01:57.626899 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:57.626899 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b5d1d2ab-9220-4827-936f-5e989ef4b85b tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] Returning 404 to user: Volume 37808c6e-c3f6-41e4-b16c-ea09d198e531 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:57.626899 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-b5d1d2ab-9220-4827-936f-5e989ef4b85b tempest-VolumesNegativeTest-642600809 tempest-VolumesNegativeTest-642600809-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/37808c6e-c3f6-41e4-b16c-ea09d198e531" status: 404 len: 109 microversion: 2.1 time: 0.046787 Sep 11 01:01:57.626899 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 415/817] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Sep 11 01:01:57 2022] GET /compute/v2.1/os-volumes/37808c6e-c3f6-41e4-b16c-ea09d198e531 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:01:57.691507 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-aad6ddf8-5336-4d9b-b6a0-4e79d90122e7 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:57.700181 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-aad6ddf8-5336-4d9b-b6a0-4e79d90122e7 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.219042 Sep 11 01:01:57.701176 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 403/818] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:57 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:57.743322 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-7b80dc4a-fc71-468b-a4ac-6cb0664d29e1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:57.744317 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-7b80dc4a-fc71-468b-a4ac-6cb0664d29e1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:57.752186 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7b80dc4a-fc71-468b-a4ac-6cb0664d29e1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:57.752674 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7b80dc4a-fc71-468b-a4ac-6cb0664d29e1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:57.753302 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7b80dc4a-fc71-468b-a4ac-6cb0664d29e1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:57.754478 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7b80dc4a-fc71-468b-a4ac-6cb0664d29e1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:57.755557 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7b80dc4a-fc71-468b-a4ac-6cb0664d29e1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:57.756143 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7b80dc4a-fc71-468b-a4ac-6cb0664d29e1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:57.912963 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-7b80dc4a-fc71-468b-a4ac-6cb0664d29e1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:57.923457 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-7b80dc4a-fc71-468b-a4ac-6cb0664d29e1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:57.924897 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-7b80dc4a-fc71-468b-a4ac-6cb0664d29e1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:57.926254 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-7b80dc4a-fc71-468b-a4ac-6cb0664d29e1 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.186846 Sep 11 01:01:57.926791 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 416/819] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:57 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:58.688150 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1ca9a907-ae48-4d27-a623-33bb0684cce3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:58.688665 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1ca9a907-ae48-4d27-a623-33bb0684cce3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:58.695423 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ca9a907-ae48-4d27-a623-33bb0684cce3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:58.695909 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ca9a907-ae48-4d27-a623-33bb0684cce3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:58.696381 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ca9a907-ae48-4d27-a623-33bb0684cce3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:58.697083 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ca9a907-ae48-4d27-a623-33bb0684cce3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:58.697534 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ca9a907-ae48-4d27-a623-33bb0684cce3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:58.697989 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ca9a907-ae48-4d27-a623-33bb0684cce3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:58.711627 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-1ca9a907-ae48-4d27-a623-33bb0684cce3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] HTTP exception thrown: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1ca9a907-ae48-4d27-a623-33bb0684cce3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Request method failure captured: Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: DELETE /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff HTTP/1.1 Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIZleOaEuAlKtiWOzScZQy__ERdzmN_Fsh18R3AG3G89WR_08snWZ6YRxuVmBkd8e4eDOuVoSFmU4H1_ArYPdT3bBFelG_bNniDYHGShKUr5tzXt-fC8Pp-PdXsUGSAqFcgcXiUSGpT-d-6G18Ajvb77CCwyMx9RJWxLsZjcUQaDz8 Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:01:58.713198 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:01:58.714986 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89e6e6a587374d53b8515f264dfd8cb6", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:58.714986 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:01:58.714986 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:01:58.714986 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:01:58.714986 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:01:58.714986 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:01:58.714986 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:01:58.714986 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 364cf4a7a3bf4e70973c78a5d690e998 Sep 11 01:01:58.714986 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:01:58.714986 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:01:58.714986 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:58.714986 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': '2bf3c5f1-9b78-4721-97e4-170c26cbf0ff'} Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:58.715964 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:58.717456 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:58.718816 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1ca9a907-ae48-4d27-a623-33bb0684cce3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Returning 404 to user: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:58.718816 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1ca9a907-ae48-4d27-a623-33bb0684cce3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 404 len: 111 microversion: 2.1 time: 0.030466 Sep 11 01:01:58.719768 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 404/820] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:01:58 2022] DELETE /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:01:58.725601 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c221bb25-ad52-46c5-b328-7dc2e6450e8c tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:58.726761 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c221bb25-ad52-46c5-b328-7dc2e6450e8c tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:58.728876 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e072d7a6-0662-4cf4-8236-bcceffb54a01 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:58.729492 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-e072d7a6-0662-4cf4-8236-bcceffb54a01 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:58.734292 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c221bb25-ad52-46c5-b328-7dc2e6450e8c tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:58.735260 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c221bb25-ad52-46c5-b328-7dc2e6450e8c tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:58.735702 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c221bb25-ad52-46c5-b328-7dc2e6450e8c tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:58.735955 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e072d7a6-0662-4cf4-8236-bcceffb54a01 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:58.736439 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e072d7a6-0662-4cf4-8236-bcceffb54a01 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:58.736555 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c221bb25-ad52-46c5-b328-7dc2e6450e8c tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:58.736872 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e072d7a6-0662-4cf4-8236-bcceffb54a01 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:58.736992 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c221bb25-ad52-46c5-b328-7dc2e6450e8c tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:58.737564 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e072d7a6-0662-4cf4-8236-bcceffb54a01 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:58.737740 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c221bb25-ad52-46c5-b328-7dc2e6450e8c tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:58.738012 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e072d7a6-0662-4cf4-8236-bcceffb54a01 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:58.738428 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e072d7a6-0662-4cf4-8236-bcceffb54a01 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:58.753171 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-e072d7a6-0662-4cf4-8236-bcceffb54a01 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] HTTP exception thrown: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e072d7a6-0662-4cf4-8236-bcceffb54a01 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Request method failure captured: Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff HTTP/1.1 Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTIZleOaEuAlKtiWOzScZQy__ERdzmN_Fsh18R3AG3G89WR_08snWZ6YRxuVmBkd8e4eDOuVoSFmU4H1_ArYPdT3bBFelG_bNniDYHGShKUr5tzXt-fC8Pp-PdXsUGSAqFcgcXiUSGpT-d-6G18Ajvb77CCwyMx9RJWxLsZjcUQaDz8 Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:01:58.754897 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:01:58.756546 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89e6e6a587374d53b8515f264dfd8cb6", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:58.756546 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:01:58.756546 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:01:58.756546 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:01:58.756546 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:01:58.756546 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:01:58.756546 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:01:58.756546 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 364cf4a7a3bf4e70973c78a5d690e998 Sep 11 01:01:58.756546 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:01:58.756546 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 01:01:58.756546 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:58.756546 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': '2bf3c5f1-9b78-4721-97e4-170c26cbf0ff'} Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:58.761768 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. Sep 11 01:01:58.764151 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:01:58.766216 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e072d7a6-0662-4cf4-8236-bcceffb54a01 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Returning 404 to user: Instance 2bf3c5f1-9b78-4721-97e4-170c26cbf0ff could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:58.766216 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-e072d7a6-0662-4cf4-8236-bcceffb54a01 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff" status: 404 len: 111 microversion: 2.1 time: 0.031321 Sep 11 01:01:58.766216 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 417/821] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:58 2022] GET /compute/v2.1/servers/2bf3c5f1-9b78-4721-97e4-170c26cbf0ff => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:01:58.903811 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c221bb25-ad52-46c5-b328-7dc2e6450e8c tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:58.911745 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c221bb25-ad52-46c5-b328-7dc2e6450e8c tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.190537 Sep 11 01:01:58.912310 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 405/822] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:58 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:01:58.951949 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6fe48de0-3fa9-451c-8b68-17f8a5647a61 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:58.952741 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6fe48de0-3fa9-451c-8b68-17f8a5647a61 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:58.960586 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6fe48de0-3fa9-451c-8b68-17f8a5647a61 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:58.961073 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6fe48de0-3fa9-451c-8b68-17f8a5647a61 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:58.961501 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6fe48de0-3fa9-451c-8b68-17f8a5647a61 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:58.962244 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6fe48de0-3fa9-451c-8b68-17f8a5647a61 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:58.962718 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6fe48de0-3fa9-451c-8b68-17f8a5647a61 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:58.963369 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6fe48de0-3fa9-451c-8b68-17f8a5647a61 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:59.103260 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6fe48de0-3fa9-451c-8b68-17f8a5647a61 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:59.112232 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6fe48de0-3fa9-451c-8b68-17f8a5647a61 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:59.113751 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6fe48de0-3fa9-451c-8b68-17f8a5647a61 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:01:59.114970 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6fe48de0-3fa9-451c-8b68-17f8a5647a61 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.167500 Sep 11 01:01:59.115549 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 418/823] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:01:58 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:01:59.919676 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e3eebc33-dc05-489d-83d9-a1c8d12d00ba tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:59.920791 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e3eebc33-dc05-489d-83d9-a1c8d12d00ba tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:59.928615 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3eebc33-dc05-489d-83d9-a1c8d12d00ba tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:59.929360 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3eebc33-dc05-489d-83d9-a1c8d12d00ba tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:59.930416 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3eebc33-dc05-489d-83d9-a1c8d12d00ba tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:59.931112 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3eebc33-dc05-489d-83d9-a1c8d12d00ba tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:59.931778 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3eebc33-dc05-489d-83d9-a1c8d12d00ba tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:59.932203 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3eebc33-dc05-489d-83d9-a1c8d12d00ba tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:59.938236 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-51aff106-1557-4ff8-98cc-b54b622b9089 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:59.939588 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-51aff106-1557-4ff8-98cc-b54b622b9089 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:59.948006 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-51aff106-1557-4ff8-98cc-b54b622b9089 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:59.948546 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-e3eebc33-dc05-489d-83d9-a1c8d12d00ba tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] HTTP exception thrown: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:01:59.949307 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-51aff106-1557-4ff8-98cc-b54b622b9089 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:59.949952 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-51aff106-1557-4ff8-98cc-b54b622b9089 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e3eebc33-dc05-489d-83d9-a1c8d12d00ba tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Request method failure captured: Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: DELETE /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 HTTP/1.1 Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIZleOaEuAlKtiWOzScZQy__ERdzmN_Fsh18R3AG3G89WR_08snWZ6YRxuVmBkd8e4eDOuVoSFmU4H1_ArYPdT3bBFelG_bNniDYHGShKUr5tzXt-fC8Pp-PdXsUGSAqFcgcXiUSGpT-d-6G18Ajvb77CCwyMx9RJWxLsZjcUQaDz8 Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:01:59.950118 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:01:59.951946 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89e6e6a587374d53b8515f264dfd8cb6", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:01:59.951946 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:01:59.951946 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:01:59.951946 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:01:59.951946 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:01:59.951946 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:01:59.951946 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:01:59.951946 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 364cf4a7a3bf4e70973c78a5d690e998 Sep 11 01:01:59.951946 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:01:59.951946 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:01:59.951946 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:01:59.951946 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': '68ba728f-6c2a-4a9c-8f55-d87c0046b7b1'} Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:01:59.952845 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:01:59.954344 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:01:59.955795 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-51aff106-1557-4ff8-98cc-b54b622b9089 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:59.955795 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-51aff106-1557-4ff8-98cc-b54b622b9089 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:59.956291 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-51aff106-1557-4ff8-98cc-b54b622b9089 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:59.956848 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e3eebc33-dc05-489d-83d9-a1c8d12d00ba tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Returning 404 to user: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:01:59.957978 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e3eebc33-dc05-489d-83d9-a1c8d12d00ba tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 404 len: 111 microversion: 2.1 time: 0.042767 Sep 11 01:01:59.958548 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 406/824] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:01:59 2022] DELETE /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:01:59.967971 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-88df3df7-79b5-4d3b-9a11-6421876dd1ea tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:01:59.968845 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-88df3df7-79b5-4d3b-9a11-6421876dd1ea tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:01:59.976491 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88df3df7-79b5-4d3b-9a11-6421876dd1ea tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:59.977216 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88df3df7-79b5-4d3b-9a11-6421876dd1ea tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:59.977771 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88df3df7-79b5-4d3b-9a11-6421876dd1ea tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:59.978629 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88df3df7-79b5-4d3b-9a11-6421876dd1ea tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:01:59.979086 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88df3df7-79b5-4d3b-9a11-6421876dd1ea tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:01:59.979568 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88df3df7-79b5-4d3b-9a11-6421876dd1ea tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:01:59.996979 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-88df3df7-79b5-4d3b-9a11-6421876dd1ea tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] HTTP exception thrown: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-88df3df7-79b5-4d3b-9a11-6421876dd1ea tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Request method failure captured: Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 HTTP/1.1 Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIZleOaEuAlKtiWOzScZQy__ERdzmN_Fsh18R3AG3G89WR_08snWZ6YRxuVmBkd8e4eDOuVoSFmU4H1_ArYPdT3bBFelG_bNniDYHGShKUr5tzXt-fC8Pp-PdXsUGSAqFcgcXiUSGpT-d-6G18Ajvb77CCwyMx9RJWxLsZjcUQaDz8 Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:01:59.998962 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:02:00.001091 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89e6e6a587374d53b8515f264dfd8cb6", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:00.001091 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:02:00.001091 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:02:00.001091 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:02:00.001091 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:02:00.001091 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:02:00.001091 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:02:00.001091 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 364cf4a7a3bf4e70973c78a5d690e998 Sep 11 01:02:00.001091 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:02:00.001091 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:02:00.001091 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:02:00.001091 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': '68ba728f-6c2a-4a9c-8f55-d87c0046b7b1'} Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:00.002015 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. Sep 11 01:02:00.004059 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.005664 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-88df3df7-79b5-4d3b-9a11-6421876dd1ea tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Returning 404 to user: Instance 68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:00.005664 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-88df3df7-79b5-4d3b-9a11-6421876dd1ea tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1" status: 404 len: 111 microversion: 2.1 time: 0.037707 Sep 11 01:02:00.005664 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 407/825] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:59 2022] GET /compute/v2.1/servers/68ba728f-6c2a-4a9c-8f55-d87c0046b7b1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:02:00.010827 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ea49f7c1-4bd8-492c-b781-54750b3692ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:00.011359 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ea49f7c1-4bd8-492c-b781-54750b3692ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:00.021117 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ea49f7c1-4bd8-492c-b781-54750b3692ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:00.021614 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ea49f7c1-4bd8-492c-b781-54750b3692ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:00.022039 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ea49f7c1-4bd8-492c-b781-54750b3692ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:00.022744 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ea49f7c1-4bd8-492c-b781-54750b3692ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:00.023648 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ea49f7c1-4bd8-492c-b781-54750b3692ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:00.024718 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ea49f7c1-4bd8-492c-b781-54750b3692ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:00.043578 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-ea49f7c1-4bd8-492c-b781-54750b3692ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] HTTP exception thrown: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ea49f7c1-4bd8-492c-b781-54750b3692ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Request method failure captured: Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: DELETE /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab HTTP/1.1 Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIZleOaEuAlKtiWOzScZQy__ERdzmN_Fsh18R3AG3G89WR_08snWZ6YRxuVmBkd8e4eDOuVoSFmU4H1_ArYPdT3bBFelG_bNniDYHGShKUr5tzXt-fC8Pp-PdXsUGSAqFcgcXiUSGpT-d-6G18Ajvb77CCwyMx9RJWxLsZjcUQaDz8 Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:02:00.046853 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:02:00.048473 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89e6e6a587374d53b8515f264dfd8cb6", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:00.048473 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:02:00.048473 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:02:00.048473 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:02:00.048473 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:02:00.048473 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:02:00.048473 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:02:00.048473 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 364cf4a7a3bf4e70973c78a5d690e998 Sep 11 01:02:00.048473 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:02:00.048473 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:02:00.048473 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 01:02:00.048473 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': 'a384877e-aaf3-4e9c-b99c-f98084c2ebab'} Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:00.049565 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 01:02:00.051037 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.054590 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ea49f7c1-4bd8-492c-b781-54750b3692ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Returning 404 to user: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:00.056154 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ea49f7c1-4bd8-492c-b781-54750b3692ac tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 404 len: 111 microversion: 2.1 time: 0.049249 Sep 11 01:02:00.059922 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 408/826] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:02:00 2022] DELETE /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:02:00.068617 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-466973bd-dc0e-41cb-8dea-0fcb409c28a3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:00.070546 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-466973bd-dc0e-41cb-8dea-0fcb409c28a3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a384877e-aaf3-4e9c-b99c-f98084c2ebab] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:00.079526 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-466973bd-dc0e-41cb-8dea-0fcb409c28a3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:00.080596 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-466973bd-dc0e-41cb-8dea-0fcb409c28a3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:00.081130 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-466973bd-dc0e-41cb-8dea-0fcb409c28a3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:00.082151 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-466973bd-dc0e-41cb-8dea-0fcb409c28a3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:00.082768 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-466973bd-dc0e-41cb-8dea-0fcb409c28a3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:00.083321 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-466973bd-dc0e-41cb-8dea-0fcb409c28a3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:00.103341 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-466973bd-dc0e-41cb-8dea-0fcb409c28a3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] HTTP exception thrown: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-466973bd-dc0e-41cb-8dea-0fcb409c28a3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Request method failure captured: Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab HTTP/1.1 Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIZleOaEuAlKtiWOzScZQy__ERdzmN_Fsh18R3AG3G89WR_08snWZ6YRxuVmBkd8e4eDOuVoSFmU4H1_ArYPdT3bBFelG_bNniDYHGShKUr5tzXt-fC8Pp-PdXsUGSAqFcgcXiUSGpT-d-6G18Ajvb77CCwyMx9RJWxLsZjcUQaDz8 Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:02:00.106385 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:02:00.108094 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89e6e6a587374d53b8515f264dfd8cb6", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:00.108094 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:02:00.108094 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:02:00.108094 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:02:00.108094 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:02:00.108094 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:02:00.108094 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:02:00.108094 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 364cf4a7a3bf4e70973c78a5d690e998 Sep 11 01:02:00.108094 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:02:00.108094 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:02:00.108094 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 01:02:00.108094 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': 'a384877e-aaf3-4e9c-b99c-f98084c2ebab'} Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:00.109002 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. Sep 11 01:02:00.110832 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:00.113518 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-466973bd-dc0e-41cb-8dea-0fcb409c28a3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Returning 404 to user: Instance a384877e-aaf3-4e9c-b99c-f98084c2ebab could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:00.113518 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-466973bd-dc0e-41cb-8dea-0fcb409c28a3 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab" status: 404 len: 111 microversion: 2.1 time: 0.048959 Sep 11 01:02:00.114399 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 409/827] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:00 2022] GET /compute/v2.1/servers/a384877e-aaf3-4e9c-b99c-f98084c2ebab => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:02:00.141836 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b1308421-a6b7-400e-a8bc-c21e1b8d36fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:00.142448 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b1308421-a6b7-400e-a8bc-c21e1b8d36fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:00.149374 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1308421-a6b7-400e-a8bc-c21e1b8d36fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:00.149859 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1308421-a6b7-400e-a8bc-c21e1b8d36fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:00.150282 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1308421-a6b7-400e-a8bc-c21e1b8d36fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:00.151050 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1308421-a6b7-400e-a8bc-c21e1b8d36fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:00.151754 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1308421-a6b7-400e-a8bc-c21e1b8d36fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:00.152878 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1308421-a6b7-400e-a8bc-c21e1b8d36fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:00.173653 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-51aff106-1557-4ff8-98cc-b54b622b9089 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:00.185445 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-51aff106-1557-4ff8-98cc-b54b622b9089 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.252481 Sep 11 01:02:00.188269 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 419/828] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:01:59 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:00.251710 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-ae606bf9-35e4-401d-ab1f-474728a3afb8 req-ccb08e70-50ba-4e1c-82a2-e647dd63c30a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff12074-d8b0-4beb-9ddb-6e617f654908", "name": "network-vif-plugged", "status": "completed", "tag": "e1f950b8-4e34-4132-8dba-e46621d7902f"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:02:00.265012 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-ae606bf9-35e4-401d-ab1f-474728a3afb8 req-ccb08e70-50ba-4e1c-82a2-e647dd63c30a service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:00.265958 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-ae606bf9-35e4-401d-ab1f-474728a3afb8 req-ccb08e70-50ba-4e1c-82a2-e647dd63c30a service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:00.266625 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-ae606bf9-35e4-401d-ab1f-474728a3afb8 req-ccb08e70-50ba-4e1c-82a2-e647dd63c30a service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:00.296644 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-ae606bf9-35e4-401d-ab1f-474728a3afb8 req-ccb08e70-50ba-4e1c-82a2-e647dd63c30a service nova] Creating event network-vif-plugged:e1f950b8-4e34-4132-8dba-e46621d7902f for instance bff12074-d8b0-4beb-9ddb-6e617f654908 on hv-cinder-maste Sep 11 01:02:00.306733 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-ae606bf9-35e4-401d-ab1f-474728a3afb8 req-ccb08e70-50ba-4e1c-82a2-e647dd63c30a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061350 Sep 11 01:02:00.307942 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 420/829] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:02:00.386945 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b1308421-a6b7-400e-a8bc-c21e1b8d36fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:00.395026 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b1308421-a6b7-400e-a8bc-c21e1b8d36fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:00.396473 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-b1308421-a6b7-400e-a8bc-c21e1b8d36fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:00.397710 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b1308421-a6b7-400e-a8bc-c21e1b8d36fb tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.259939 Sep 11 01:02:00.398263 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 410/830] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:02:00 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 01:02:01.225188 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d00d3c34-482a-4843-9fe4-eff8064641db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:01.225989 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d00d3c34-482a-4843-9fe4-eff8064641db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:01.232782 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d00d3c34-482a-4843-9fe4-eff8064641db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:01.233360 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d00d3c34-482a-4843-9fe4-eff8064641db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:01.233868 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d00d3c34-482a-4843-9fe4-eff8064641db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:01.234621 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d00d3c34-482a-4843-9fe4-eff8064641db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:01.235005 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d00d3c34-482a-4843-9fe4-eff8064641db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:01.235485 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d00d3c34-482a-4843-9fe4-eff8064641db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:01.372255 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d00d3c34-482a-4843-9fe4-eff8064641db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:01.378255 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-42aab7ad-b9d0-4bec-bdf7-accb7ed82e73 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:01.378743 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-42aab7ad-b9d0-4bec-bdf7-accb7ed82e73 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:01.380982 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d00d3c34-482a-4843-9fe4-eff8064641db tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.160531 Sep 11 01:02:01.385719 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42aab7ad-b9d0-4bec-bdf7-accb7ed82e73 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:01.386212 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42aab7ad-b9d0-4bec-bdf7-accb7ed82e73 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:01.386688 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42aab7ad-b9d0-4bec-bdf7-accb7ed82e73 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:01.387418 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42aab7ad-b9d0-4bec-bdf7-accb7ed82e73 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:01.387876 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42aab7ad-b9d0-4bec-bdf7-accb7ed82e73 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:01.388625 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42aab7ad-b9d0-4bec-bdf7-accb7ed82e73 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:01.395636 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 421/831] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:01 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:01.402339 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-42aab7ad-b9d0-4bec-bdf7-accb7ed82e73 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] HTTP exception thrown: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-42aab7ad-b9d0-4bec-bdf7-accb7ed82e73 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Request method failure captured: Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: DELETE /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a HTTP/1.1 Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTIZleOaEuAlKtiWOzScZQy__ERdzmN_Fsh18R3AG3G89WR_08snWZ6YRxuVmBkd8e4eDOuVoSFmU4H1_ArYPdT3bBFelG_bNniDYHGShKUr5tzXt-fC8Pp-PdXsUGSAqFcgcXiUSGpT-d-6G18Ajvb77CCwyMx9RJWxLsZjcUQaDz8 Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:02:01.404056 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:02:01.405651 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89e6e6a587374d53b8515f264dfd8cb6", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:01.405651 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:02:01.405651 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:02:01.405651 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:02:01.405651 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:02:01.405651 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:02:01.405651 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:02:01.405651 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 364cf4a7a3bf4e70973c78a5d690e998 Sep 11 01:02:01.405651 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:02:01.405651 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:02:01.405651 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 01:02:01.405651 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': 'a5a68ae4-8f64-474d-aca7-974bd8fd266a'} Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:01.409645 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 01:02:01.411264 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:01.413408 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-42aab7ad-b9d0-4bec-bdf7-accb7ed82e73 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Returning 404 to user: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:01.413408 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-42aab7ad-b9d0-4bec-bdf7-accb7ed82e73 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 404 len: 111 microversion: 2.1 time: 0.031220 Sep 11 01:02:01.413408 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 411/832] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:02:01 2022] DELETE /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 01:02:01.415608 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-2b11abe9-ed0d-43b0-aa32-af329b52ebc6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:01.416249 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-2b11abe9-ed0d-43b0-aa32-af329b52ebc6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] [instance: a5a68ae4-8f64-474d-aca7-974bd8fd266a] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:01.422682 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2b11abe9-ed0d-43b0-aa32-af329b52ebc6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:01.423168 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2b11abe9-ed0d-43b0-aa32-af329b52ebc6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:01.423640 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2b11abe9-ed0d-43b0-aa32-af329b52ebc6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:01.424042 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-35a904db-b143-47bd-9519-3b0a5942ff76 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:01.424321 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2b11abe9-ed0d-43b0-aa32-af329b52ebc6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:01.424772 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2b11abe9-ed0d-43b0-aa32-af329b52ebc6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:01.424927 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-35a904db-b143-47bd-9519-3b0a5942ff76 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:01.425186 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-2b11abe9-ed0d-43b0-aa32-af329b52ebc6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:01.430991 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-35a904db-b143-47bd-9519-3b0a5942ff76 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:01.431582 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-35a904db-b143-47bd-9519-3b0a5942ff76 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:01.432088 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-35a904db-b143-47bd-9519-3b0a5942ff76 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:01.432849 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-35a904db-b143-47bd-9519-3b0a5942ff76 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:01.433361 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-35a904db-b143-47bd-9519-3b0a5942ff76 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:01.433846 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-35a904db-b143-47bd-9519-3b0a5942ff76 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:01.440155 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-2b11abe9-ed0d-43b0-aa32-af329b52ebc6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] HTTP exception thrown: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-2b11abe9-ed0d-43b0-aa32-af329b52ebc6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Request method failure captured: Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a HTTP/1.1 Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTIZleOaEuAlKtiWOzScZQy__ERdzmN_Fsh18R3AG3G89WR_08snWZ6YRxuVmBkd8e4eDOuVoSFmU4H1_ArYPdT3bBFelG_bNniDYHGShKUr5tzXt-fC8Pp-PdXsUGSAqFcgcXiUSGpT-d-6G18Ajvb77CCwyMx9RJWxLsZjcUQaDz8 Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:02:01.442118 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:02:01.451309 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89e6e6a587374d53b8515f264dfd8cb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89e6e6a587374d53b8515f264dfd8cb6", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:01.451309 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:02:01.451309 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 89e6e6a587374d53b8515f264dfd8cb6 Sep 11 01:02:01.451309 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-835741757 Sep 11 01:02:01.451309 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:02:01.451309 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:02:01.451309 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:02:01.451309 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 364cf4a7a3bf4e70973c78a5d690e998 Sep 11 01:02:01.451309 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-AttachVolumeNegativeTest-835741757-project Sep 11 01:02:01.451309 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 01:02:01.451309 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 01:02:01.451309 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': 'a5a68ae4-8f64-474d-aca7-974bd8fd266a'} Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:01.453036 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. Sep 11 01:02:01.455568 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:01.458104 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-2b11abe9-ed0d-43b0-aa32-af329b52ebc6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] Returning 404 to user: Instance a5a68ae4-8f64-474d-aca7-974bd8fd266a could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:01.458104 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-2b11abe9-ed0d-43b0-aa32-af329b52ebc6 tempest-AttachVolumeNegativeTest-835741757 tempest-AttachVolumeNegativeTest-835741757-project] 10.222.0.23 "GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a" status: 404 len: 111 microversion: 2.1 time: 0.032624 Sep 11 01:02:01.458104 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 422/833] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:01 2022] GET /compute/v2.1/servers/a5a68ae4-8f64-474d-aca7-974bd8fd266a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:02:01.596145 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-35a904db-b143-47bd-9519-3b0a5942ff76 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:01.604441 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-35a904db-b143-47bd-9519-3b0a5942ff76 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:01.605913 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-35a904db-b143-47bd-9519-3b0a5942ff76 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:01.607086 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-35a904db-b143-47bd-9519-3b0a5942ff76 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1727 microversion: 2.20 time: 0.187075 Sep 11 01:02:01.607668 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 412/834] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:02:01 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 01:02:02.324359 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-8e4fc36e-b6ba-47a5-bfba-4cde13711814 req-3e51a45a-8476-406f-934f-34c384fc5f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5bd672b-a759-47a8-8c53-7f54e272cc46", "name": "network-vif-plugged", "status": "completed", "tag": "80f34462-a935-454d-99ce-542f2487460d"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:02:02.335339 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-8e4fc36e-b6ba-47a5-bfba-4cde13711814 req-3e51a45a-8476-406f-934f-34c384fc5f31 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:02.335886 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-8e4fc36e-b6ba-47a5-bfba-4cde13711814 req-3e51a45a-8476-406f-934f-34c384fc5f31 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:02.336379 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-8e4fc36e-b6ba-47a5-bfba-4cde13711814 req-3e51a45a-8476-406f-934f-34c384fc5f31 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:02.348896 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-8e4fc36e-b6ba-47a5-bfba-4cde13711814 req-3e51a45a-8476-406f-934f-34c384fc5f31 service nova] Creating event network-vif-plugged:80f34462-a935-454d-99ce-542f2487460d for instance e5bd672b-a759-47a8-8c53-7f54e272cc46 on hv-cinder-maste Sep 11 01:02:02.355150 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-8e4fc36e-b6ba-47a5-bfba-4cde13711814 req-3e51a45a-8476-406f-934f-34c384fc5f31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034674 Sep 11 01:02:02.359086 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 423/835] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:02:02.404394 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-79fa928c-e152-4103-95a2-f6174ed7f57b tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:02.404990 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-79fa928c-e152-4103-95a2-f6174ed7f57b tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:02.411614 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79fa928c-e152-4103-95a2-f6174ed7f57b tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:02.412096 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79fa928c-e152-4103-95a2-f6174ed7f57b tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:02.412908 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79fa928c-e152-4103-95a2-f6174ed7f57b tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:02.413774 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79fa928c-e152-4103-95a2-f6174ed7f57b tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:02.414377 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79fa928c-e152-4103-95a2-f6174ed7f57b tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:02.414948 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79fa928c-e152-4103-95a2-f6174ed7f57b tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:02.594940 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-79fa928c-e152-4103-95a2-f6174ed7f57b tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:02.611088 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-79fa928c-e152-4103-95a2-f6174ed7f57b tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.211028 Sep 11 01:02:02.619352 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 413/836] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:02 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:02.633237 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5edb2925-151f-476c-b7b5-a03ac4b7e25d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:02.633925 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-5edb2925-151f-476c-b7b5-a03ac4b7e25d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:02.645244 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5edb2925-151f-476c-b7b5-a03ac4b7e25d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:02.646965 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5edb2925-151f-476c-b7b5-a03ac4b7e25d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:02.649103 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5edb2925-151f-476c-b7b5-a03ac4b7e25d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:02.649906 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5edb2925-151f-476c-b7b5-a03ac4b7e25d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:02.650377 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5edb2925-151f-476c-b7b5-a03ac4b7e25d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:02.651013 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5edb2925-151f-476c-b7b5-a03ac4b7e25d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:03.171094 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-5edb2925-151f-476c-b7b5-a03ac4b7e25d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:03.183282 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-5edb2925-151f-476c-b7b5-a03ac4b7e25d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:03.185473 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-5edb2925-151f-476c-b7b5-a03ac4b7e25d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:03.186992 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-5edb2925-151f-476c-b7b5-a03ac4b7e25d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1714 microversion: 2.20 time: 0.557740 Sep 11 01:02:03.188094 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 424/837] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:02:02 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1714 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:02:03.641833 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7c0a667a-4f20-4435-b16a-6d51e889bb21 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:03.643346 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7c0a667a-4f20-4435-b16a-6d51e889bb21 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:03.652185 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c0a667a-4f20-4435-b16a-6d51e889bb21 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:03.657565 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c0a667a-4f20-4435-b16a-6d51e889bb21 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:03.660342 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c0a667a-4f20-4435-b16a-6d51e889bb21 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:03.661301 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c0a667a-4f20-4435-b16a-6d51e889bb21 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:03.662257 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c0a667a-4f20-4435-b16a-6d51e889bb21 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:03.663290 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c0a667a-4f20-4435-b16a-6d51e889bb21 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:03.686759 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5ee3b34c-9c18-46a1-9bfa-e5bd28a28a1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:02:03.691017 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-5ee3b34c-9c18-46a1-9bfa-e5bd28a28a1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:03.701504 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ee3b34c-9c18-46a1-9bfa-e5bd28a28a1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:03.702349 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ee3b34c-9c18-46a1-9bfa-e5bd28a28a1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:03.703250 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ee3b34c-9c18-46a1-9bfa-e5bd28a28a1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:03.704424 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ee3b34c-9c18-46a1-9bfa-e5bd28a28a1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:03.705176 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ee3b34c-9c18-46a1-9bfa-e5bd28a28a1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:03.705961 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ee3b34c-9c18-46a1-9bfa-e5bd28a28a1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:03.741504 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=100 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:03.844018 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-5ee3b34c-9c18-46a1-9bfa-e5bd28a28a1d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "POST /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/action" status: 202 len: 0 microversion: 2.1 time: 0.163407 Sep 11 01:02:03.855916 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 425/838] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Sep 11 01:02:03 2022] POST /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 01:02:03.856236 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-7c0a667a-4f20-4435-b16a-6d51e889bb21 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:03.865969 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7c0a667a-4f20-4435-b16a-6d51e889bb21 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1314 microversion: 2.1 time: 0.228528 Sep 11 01:02:03.866553 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 414/839] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:03 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:03.866693 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8d856b1f-ca64-4bef-a18f-2947117a2fb6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:03.867485 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-8d856b1f-ca64-4bef-a18f-2947117a2fb6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:03.874433 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8d856b1f-ca64-4bef-a18f-2947117a2fb6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:03.875032 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8d856b1f-ca64-4bef-a18f-2947117a2fb6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:03.875612 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8d856b1f-ca64-4bef-a18f-2947117a2fb6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:03.876539 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8d856b1f-ca64-4bef-a18f-2947117a2fb6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:03.877255 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8d856b1f-ca64-4bef-a18f-2947117a2fb6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:03.877970 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8d856b1f-ca64-4bef-a18f-2947117a2fb6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:04.082201 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8d856b1f-ca64-4bef-a18f-2947117a2fb6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:04.097801 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8d856b1f-ca64-4bef-a18f-2947117a2fb6 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1750 microversion: 2.1 time: 0.236167 Sep 11 01:02:04.112462 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 426/840] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:03 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1750 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:04.889889 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bd9d8b0e-cec5-43a1-bb44-c2cdb15ac358 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:04.891421 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bd9d8b0e-cec5-43a1-bb44-c2cdb15ac358 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:04.899492 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd9d8b0e-cec5-43a1-bb44-c2cdb15ac358 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:04.900286 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd9d8b0e-cec5-43a1-bb44-c2cdb15ac358 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:04.901036 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd9d8b0e-cec5-43a1-bb44-c2cdb15ac358 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:04.901958 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd9d8b0e-cec5-43a1-bb44-c2cdb15ac358 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:04.902573 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd9d8b0e-cec5-43a1-bb44-c2cdb15ac358 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:04.903254 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd9d8b0e-cec5-43a1-bb44-c2cdb15ac358 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:05.124355 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-921c09c0-9855-4aa2-86e1-62e1b963622f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:05.125115 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-921c09c0-9855-4aa2-86e1-62e1b963622f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:05.137704 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-921c09c0-9855-4aa2-86e1-62e1b963622f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:05.138324 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-921c09c0-9855-4aa2-86e1-62e1b963622f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:05.138827 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-921c09c0-9855-4aa2-86e1-62e1b963622f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:05.139740 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-921c09c0-9855-4aa2-86e1-62e1b963622f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:05.140598 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-921c09c0-9855-4aa2-86e1-62e1b963622f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:05.141138 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-921c09c0-9855-4aa2-86e1-62e1b963622f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:05.244925 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-bd9d8b0e-cec5-43a1-bb44-c2cdb15ac358 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:05.265797 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bd9d8b0e-cec5-43a1-bb44-c2cdb15ac358 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1497 microversion: 2.1 time: 0.380615 Sep 11 01:02:05.266406 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 415/841] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:04 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1497 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:05.457369 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-921c09c0-9855-4aa2-86e1-62e1b963622f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:05.466705 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-921c09c0-9855-4aa2-86e1-62e1b963622f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1750 microversion: 2.1 time: 0.347164 Sep 11 01:02:05.471231 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 427/842] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:05 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1750 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:06.498296 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1a80e0b0-26ea-410b-8f50-e79eed75517d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:06.499046 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1a80e0b0-26ea-410b-8f50-e79eed75517d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:06.506580 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1a80e0b0-26ea-410b-8f50-e79eed75517d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:06.507160 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1a80e0b0-26ea-410b-8f50-e79eed75517d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:06.507537 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1a80e0b0-26ea-410b-8f50-e79eed75517d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:06.508234 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1a80e0b0-26ea-410b-8f50-e79eed75517d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:06.508677 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1a80e0b0-26ea-410b-8f50-e79eed75517d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:06.509119 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1a80e0b0-26ea-410b-8f50-e79eed75517d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:06.692376 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-1a80e0b0-26ea-410b-8f50-e79eed75517d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:06.705916 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1a80e0b0-26ea-410b-8f50-e79eed75517d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1755 microversion: 2.1 time: 0.211436 Sep 11 01:02:06.706541 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 416/843] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:06 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1755 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:07.729585 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-02402c2d-0697-43a1-9bab-f4b1cfb1f4bb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:07.730301 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-02402c2d-0697-43a1-9bab-f4b1cfb1f4bb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:07.737199 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-02402c2d-0697-43a1-9bab-f4b1cfb1f4bb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:07.737754 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-02402c2d-0697-43a1-9bab-f4b1cfb1f4bb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:07.738191 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-02402c2d-0697-43a1-9bab-f4b1cfb1f4bb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:07.738886 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-02402c2d-0697-43a1-9bab-f4b1cfb1f4bb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:07.739360 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-02402c2d-0697-43a1-9bab-f4b1cfb1f4bb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:07.739778 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-02402c2d-0697-43a1-9bab-f4b1cfb1f4bb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:07.900815 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-02402c2d-0697-43a1-9bab-f4b1cfb1f4bb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:07.909090 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-02402c2d-0697-43a1-9bab-f4b1cfb1f4bb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1755 microversion: 2.1 time: 0.183833 Sep 11 01:02:07.909651 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 428/844] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:07 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:08.509505 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0570bdcb-0f57-4bc7-ab5f-3f04c2ab4fdf tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:08.510050 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0570bdcb-0f57-4bc7-ab5f-3f04c2ab4fdf tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:08.516612 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0570bdcb-0f57-4bc7-ab5f-3f04c2ab4fdf tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:08.517091 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0570bdcb-0f57-4bc7-ab5f-3f04c2ab4fdf tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:08.517578 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0570bdcb-0f57-4bc7-ab5f-3f04c2ab4fdf tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:08.518365 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0570bdcb-0f57-4bc7-ab5f-3f04c2ab4fdf tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:08.518820 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0570bdcb-0f57-4bc7-ab5f-3f04c2ab4fdf tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:08.519304 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0570bdcb-0f57-4bc7-ab5f-3f04c2ab4fdf tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:08.534563 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:08.546198 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0570bdcb-0f57-4bc7-ab5f-3f04c2ab4fdf tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 01:02:08.631807 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0570bdcb-0f57-4bc7-ab5f-3f04c2ab4fdf tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 204 len: 0 microversion: 2.1 time: 0.125990 Sep 11 01:02:08.632681 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 417/845] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:02:08 2022] DELETE /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 01:02:08.641379 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-7a784213-d044-4437-8584-705ad922f294 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:08.642084 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-7a784213-d044-4437-8584-705ad922f294 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:08.648417 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7a784213-d044-4437-8584-705ad922f294 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:08.648899 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7a784213-d044-4437-8584-705ad922f294 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:08.649382 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7a784213-d044-4437-8584-705ad922f294 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:08.650187 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7a784213-d044-4437-8584-705ad922f294 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:08.650768 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7a784213-d044-4437-8584-705ad922f294 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:08.651245 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-7a784213-d044-4437-8584-705ad922f294 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:08.784506 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-7a784213-d044-4437-8584-705ad922f294 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:08.792668 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-7a784213-d044-4437-8584-705ad922f294 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1503 microversion: 2.1 time: 0.155605 Sep 11 01:02:08.793301 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 429/846] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:08 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:08.933982 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c00e6538-aed0-4675-8ef7-40bc7e39d011 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:08.934675 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c00e6538-aed0-4675-8ef7-40bc7e39d011 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:08.940952 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c00e6538-aed0-4675-8ef7-40bc7e39d011 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:08.941549 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c00e6538-aed0-4675-8ef7-40bc7e39d011 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:08.942015 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c00e6538-aed0-4675-8ef7-40bc7e39d011 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:08.942684 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c00e6538-aed0-4675-8ef7-40bc7e39d011 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:08.943236 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c00e6538-aed0-4675-8ef7-40bc7e39d011 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:08.943663 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c00e6538-aed0-4675-8ef7-40bc7e39d011 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:09.089079 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c00e6538-aed0-4675-8ef7-40bc7e39d011 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:09.097550 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c00e6538-aed0-4675-8ef7-40bc7e39d011 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1755 microversion: 2.1 time: 0.167933 Sep 11 01:02:09.098147 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 418/847] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:08 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:09.815961 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-9de7b67a-82f2-4339-b547-2e12ef788364 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:09.817224 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-9de7b67a-82f2-4339-b547-2e12ef788364 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:09.824126 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9de7b67a-82f2-4339-b547-2e12ef788364 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:09.824845 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9de7b67a-82f2-4339-b547-2e12ef788364 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:09.825630 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9de7b67a-82f2-4339-b547-2e12ef788364 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:09.826660 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9de7b67a-82f2-4339-b547-2e12ef788364 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:09.827295 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9de7b67a-82f2-4339-b547-2e12ef788364 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:09.827868 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-9de7b67a-82f2-4339-b547-2e12ef788364 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:10.019670 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-9de7b67a-82f2-4339-b547-2e12ef788364 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:10.028190 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-9de7b67a-82f2-4339-b547-2e12ef788364 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1503 microversion: 2.1 time: 0.216388 Sep 11 01:02:10.028769 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 430/848] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:09 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:10.122642 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-88b0e15b-e1fa-4d29-9271-b8058e1cfb98 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:10.123530 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-88b0e15b-e1fa-4d29-9271-b8058e1cfb98 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:10.130041 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88b0e15b-e1fa-4d29-9271-b8058e1cfb98 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:10.130570 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88b0e15b-e1fa-4d29-9271-b8058e1cfb98 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:10.130958 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88b0e15b-e1fa-4d29-9271-b8058e1cfb98 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:10.131916 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88b0e15b-e1fa-4d29-9271-b8058e1cfb98 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:10.132373 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88b0e15b-e1fa-4d29-9271-b8058e1cfb98 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:10.132795 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88b0e15b-e1fa-4d29-9271-b8058e1cfb98 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:10.293694 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-88b0e15b-e1fa-4d29-9271-b8058e1cfb98 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:10.315204 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-88b0e15b-e1fa-4d29-9271-b8058e1cfb98 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1755 microversion: 2.1 time: 0.197762 Sep 11 01:02:10.316330 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 419/849] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:10 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:10.826778 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-a043170e-e4cc-4cb8-bc51-92c8b8bd6490 req-2e4cfec2-7b37-44d2-89a2-4b7346bd2d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5bd672b-a759-47a8-8c53-7f54e272cc46", "name": "network-vif-deleted", "tag": "80f34462-a935-454d-99ce-542f2487460d"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:02:10.837080 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-a043170e-e4cc-4cb8-bc51-92c8b8bd6490 req-2e4cfec2-7b37-44d2-89a2-4b7346bd2d1c service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:10.837552 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-a043170e-e4cc-4cb8-bc51-92c8b8bd6490 req-2e4cfec2-7b37-44d2-89a2-4b7346bd2d1c service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:10.837977 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-a043170e-e4cc-4cb8-bc51-92c8b8bd6490 req-2e4cfec2-7b37-44d2-89a2-4b7346bd2d1c service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:10.849386 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-a043170e-e4cc-4cb8-bc51-92c8b8bd6490 req-2e4cfec2-7b37-44d2-89a2-4b7346bd2d1c service nova] Creating event network-vif-deleted:80f34462-a935-454d-99ce-542f2487460d for instance e5bd672b-a759-47a8-8c53-7f54e272cc46 on hv-cinder-maste Sep 11 01:02:10.854233 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-a043170e-e4cc-4cb8-bc51-92c8b8bd6490 req-2e4cfec2-7b37-44d2-89a2-4b7346bd2d1c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031162 Sep 11 01:02:10.855158 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 431/850] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:02:11.058594 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2e235ec4-1a3c-4f8b-8ece-595a133b5ecc tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:11.059860 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2e235ec4-1a3c-4f8b-8ece-595a133b5ecc tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:11.067126 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e235ec4-1a3c-4f8b-8ece-595a133b5ecc tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:11.067733 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e235ec4-1a3c-4f8b-8ece-595a133b5ecc tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:11.068163 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e235ec4-1a3c-4f8b-8ece-595a133b5ecc tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:11.069062 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e235ec4-1a3c-4f8b-8ece-595a133b5ecc tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:11.069682 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e235ec4-1a3c-4f8b-8ece-595a133b5ecc tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:11.071231 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e235ec4-1a3c-4f8b-8ece-595a133b5ecc tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:11.102713 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e235ec4-1a3c-4f8b-8ece-595a133b5ecc tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:11.103214 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e235ec4-1a3c-4f8b-8ece-595a133b5ecc tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:11.103656 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2e235ec4-1a3c-4f8b-8ece-595a133b5ecc tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:11.104105 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-2e235ec4-1a3c-4f8b-8ece-595a133b5ecc tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lazy-loading 'fault' on Instance uuid e5bd672b-a759-47a8-8c53-7f54e272cc46 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:02:11.153652 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-2e235ec4-1a3c-4f8b-8ece-595a133b5ecc tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e7fce78cc74e0aace9b0956762c126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1f92f790a043bf9848695a5c517857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:11.165552 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2e235ec4-1a3c-4f8b-8ece-595a133b5ecc tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 200 len: 1304 microversion: 2.1 time: 0.110868 Sep 11 01:02:11.166000 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 420/851] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:11 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:11.341129 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-60be51cb-b83a-4637-878a-fca76dd2187d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:11.341826 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-60be51cb-b83a-4637-878a-fca76dd2187d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:11.348382 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-60be51cb-b83a-4637-878a-fca76dd2187d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:11.349048 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-60be51cb-b83a-4637-878a-fca76dd2187d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:11.349488 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-60be51cb-b83a-4637-878a-fca76dd2187d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:11.350181 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-60be51cb-b83a-4637-878a-fca76dd2187d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:11.350623 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-60be51cb-b83a-4637-878a-fca76dd2187d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:11.351038 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-60be51cb-b83a-4637-878a-fca76dd2187d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:11.513919 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-60be51cb-b83a-4637-878a-fca76dd2187d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:11.523957 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-60be51cb-b83a-4637-878a-fca76dd2187d tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1755 microversion: 2.1 time: 0.188387 Sep 11 01:02:11.524579 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 432/852] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:11 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:12.188512 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-81c719ec-5ab5-4632-95d9-352b208b3726 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:12.189134 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-81c719ec-5ab5-4632-95d9-352b208b3726 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] [instance: e5bd672b-a759-47a8-8c53-7f54e272cc46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:12.191690 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:12.197063 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-81c719ec-5ab5-4632-95d9-352b208b3726 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:12.197907 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-81c719ec-5ab5-4632-95d9-352b208b3726 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:12.198395 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-81c719ec-5ab5-4632-95d9-352b208b3726 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:12.199108 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-81c719ec-5ab5-4632-95d9-352b208b3726 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:12.199616 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-81c719ec-5ab5-4632-95d9-352b208b3726 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:12.200042 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-81c719ec-5ab5-4632-95d9-352b208b3726 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:12.217588 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-81c719ec-5ab5-4632-95d9-352b208b3726 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] HTTP exception thrown: Instance e5bd672b-a759-47a8-8c53-7f54e272cc46 could not be found. Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-81c719ec-5ab5-4632-95d9-352b208b3726 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Request method failure captured: Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 HTTP/1.1 Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTNyXKkCieBsL2QPudOpOa3ynBp9NFWRSeQDHNZIYmZ4uFjnqZJkketayrBxF5vkfd7T9yZx2TCxGtg4uiW9g04Y76eTNAlANnd744ai9zpwRQz6XM0ASC9tQ8Ou1Q2DT8bm-V-6d-tgXmzRJcf7Q3BnAI0gT-Nz0-SvhTiapxxwQ50 Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 6b1f92f790a043bf9848695a5c517857 Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesActionsTest-1724869028 Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:02:12.219328 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:02:12.220792 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6b1f92f790a043bf9848695a5c517857"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6b1f92f790a043bf9848695a5c517857"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6b1f92f790a043bf9848695a5c517857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6b1f92f790a043bf9848695a5c517857", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:12.220792 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-VolumesActionsTest-1724869028 Sep 11 01:02:12.220792 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 6b1f92f790a043bf9848695a5c517857 Sep 11 01:02:12.220792 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesActionsTest-1724869028 Sep 11 01:02:12.220792 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-VolumesActionsTest-1724869028-project Sep 11 01:02:12.220792 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:02:12.220792 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:02:12.220792 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 26e7fce78cc74e0aace9b0956762c126 Sep 11 01:02:12.220792 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-VolumesActionsTest-1724869028-project Sep 11 01:02:12.220792 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:02:12.220792 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance e5bd672b-a759-47a8-8c53-7f54e272cc46 could not be found. Sep 11 01:02:12.220792 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': 'e5bd672b-a759-47a8-8c53-7f54e272cc46'} Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5bd672b-a759-47a8-8c53-7f54e272cc46 could not be found. Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:12.221586 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5bd672b-a759-47a8-8c53-7f54e272cc46 could not be found. Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5bd672b-a759-47a8-8c53-7f54e272cc46 could not be found. Sep 11 01:02:12.222853 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:12.224123 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-81c719ec-5ab5-4632-95d9-352b208b3726 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] Returning 404 to user: Instance e5bd672b-a759-47a8-8c53-7f54e272cc46 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:12.224123 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-81c719ec-5ab5-4632-95d9-352b208b3726 tempest-VolumesActionsTest-1724869028 tempest-VolumesActionsTest-1724869028-project] 10.222.0.23 "GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46" status: 404 len: 111 microversion: 2.1 time: 0.036160 Sep 11 01:02:12.224123 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 421/853] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:12 2022] GET /compute/v2.1/servers/e5bd672b-a759-47a8-8c53-7f54e272cc46 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:02:12.550081 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8665bd4a-6110-4035-a376-f52de0218c24 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:12.551348 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-8665bd4a-6110-4035-a376-f52de0218c24 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:12.559580 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8665bd4a-6110-4035-a376-f52de0218c24 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:12.560359 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8665bd4a-6110-4035-a376-f52de0218c24 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:12.560788 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8665bd4a-6110-4035-a376-f52de0218c24 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:12.561486 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8665bd4a-6110-4035-a376-f52de0218c24 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:12.562168 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8665bd4a-6110-4035-a376-f52de0218c24 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:12.562714 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8665bd4a-6110-4035-a376-f52de0218c24 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:12.718011 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8665bd4a-6110-4035-a376-f52de0218c24 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:12.726642 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8665bd4a-6110-4035-a376-f52de0218c24 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1755 microversion: 2.1 time: 0.181120 Sep 11 01:02:12.727229 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 433/854] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:12 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:13.750795 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-56f1f403-81f7-417b-a4db-b658257cc26c tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:13.751460 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-56f1f403-81f7-417b-a4db-b658257cc26c tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:13.758528 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-56f1f403-81f7-417b-a4db-b658257cc26c tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:13.759113 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-56f1f403-81f7-417b-a4db-b658257cc26c tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:13.759550 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-56f1f403-81f7-417b-a4db-b658257cc26c tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:13.760362 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-56f1f403-81f7-417b-a4db-b658257cc26c tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:13.760809 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-56f1f403-81f7-417b-a4db-b658257cc26c tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:13.761239 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-56f1f403-81f7-417b-a4db-b658257cc26c tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:13.934188 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-56f1f403-81f7-417b-a4db-b658257cc26c tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:13.943464 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-56f1f403-81f7-417b-a4db-b658257cc26c tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1755 microversion: 2.1 time: 0.197062 Sep 11 01:02:13.944038 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 422/855] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:13 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1755 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:14.969232 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f68abef4-e765-478c-9775-f291ba8da69b tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:14.969925 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f68abef4-e765-478c-9775-f291ba8da69b tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:14.977239 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f68abef4-e765-478c-9775-f291ba8da69b tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:14.978014 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f68abef4-e765-478c-9775-f291ba8da69b tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:14.978440 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f68abef4-e765-478c-9775-f291ba8da69b tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:14.979320 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f68abef4-e765-478c-9775-f291ba8da69b tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:14.979971 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f68abef4-e765-478c-9775-f291ba8da69b tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:14.980705 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f68abef4-e765-478c-9775-f291ba8da69b tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:15.171734 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f68abef4-e765-478c-9775-f291ba8da69b tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:15.181467 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f68abef4-e765-478c-9775-f291ba8da69b tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1755 microversion: 2.1 time: 0.216367 Sep 11 01:02:15.182446 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 434/856] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:14 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:16.205856 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f6737e61-dcb3-4214-a016-1437c29b77d1 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:16.206470 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f6737e61-dcb3-4214-a016-1437c29b77d1 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:16.213364 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f6737e61-dcb3-4214-a016-1437c29b77d1 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:16.213835 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f6737e61-dcb3-4214-a016-1437c29b77d1 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:16.214264 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f6737e61-dcb3-4214-a016-1437c29b77d1 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:16.214950 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f6737e61-dcb3-4214-a016-1437c29b77d1 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:16.215450 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f6737e61-dcb3-4214-a016-1437c29b77d1 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:16.215862 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f6737e61-dcb3-4214-a016-1437c29b77d1 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:16.376417 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f6737e61-dcb3-4214-a016-1437c29b77d1 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:16.384979 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f6737e61-dcb3-4214-a016-1437c29b77d1 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1755 microversion: 2.1 time: 0.183067 Sep 11 01:02:16.385546 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 423/857] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:16 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:17.409147 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-72dc8362-274a-4d21-905b-db2c6b46f637 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:17.410074 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-72dc8362-274a-4d21-905b-db2c6b46f637 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:17.417545 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-72dc8362-274a-4d21-905b-db2c6b46f637 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:17.418058 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-72dc8362-274a-4d21-905b-db2c6b46f637 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:17.418556 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-72dc8362-274a-4d21-905b-db2c6b46f637 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:17.419344 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-72dc8362-274a-4d21-905b-db2c6b46f637 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:17.419811 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-72dc8362-274a-4d21-905b-db2c6b46f637 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:17.420285 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-72dc8362-274a-4d21-905b-db2c6b46f637 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:17.581293 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-72dc8362-274a-4d21-905b-db2c6b46f637 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:17.590431 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-72dc8362-274a-4d21-905b-db2c6b46f637 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1758 microversion: 2.1 time: 0.185454 Sep 11 01:02:17.591420 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 435/858] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:17 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:36.524055 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-844118e1-a142-435c-9c98-25596ee37b6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:36.526312 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-844118e1-a142-435c-9c98-25596ee37b6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:36.528982 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=5 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:36.529694 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:36.535711 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-844118e1-a142-435c-9c98-25596ee37b6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:36.536188 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-844118e1-a142-435c-9c98-25596ee37b6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:36.536615 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-844118e1-a142-435c-9c98-25596ee37b6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:36.537657 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-844118e1-a142-435c-9c98-25596ee37b6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:36.538104 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-844118e1-a142-435c-9c98-25596ee37b6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:36.538517 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-844118e1-a142-435c-9c98-25596ee37b6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:36.569140 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-844118e1-a142-435c-9c98-25596ee37b6f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049602 Sep 11 01:02:36.569692 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 424/859] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Sep 11 01:02:36 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:36.635034 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-185d4f19-84c0-47c5-b192-4901439fc97d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:36.635555 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-185d4f19-84c0-47c5-b192-4901439fc97d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:36.637740 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=56 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:36.638426 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:36.644870 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-185d4f19-84c0-47c5-b192-4901439fc97d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:36.645354 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-185d4f19-84c0-47c5-b192-4901439fc97d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:36.645792 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-185d4f19-84c0-47c5-b192-4901439fc97d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:36.646487 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-185d4f19-84c0-47c5-b192-4901439fc97d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:36.646940 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-185d4f19-84c0-47c5-b192-4901439fc97d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:36.647397 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-185d4f19-84c0-47c5-b192-4901439fc97d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:36.674261 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-185d4f19-84c0-47c5-b192-4901439fc97d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Going to try to terminate instance {{(pid=120497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 01:02:36.760412 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-185d4f19-84c0-47c5-b192-4901439fc97d tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 204 len: 0 microversion: 2.20 time: 0.129212 Sep 11 01:02:36.761085 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 436/860] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Sep 11 01:02:36 2022] DELETE /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 01:02:36.770339 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4541a557-ffc3-4b26-ad0b-a085a563e419 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:36.770933 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4541a557-ffc3-4b26-ad0b-a085a563e419 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:36.776970 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4541a557-ffc3-4b26-ad0b-a085a563e419 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:36.777446 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4541a557-ffc3-4b26-ad0b-a085a563e419 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:36.777942 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4541a557-ffc3-4b26-ad0b-a085a563e419 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:36.778615 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4541a557-ffc3-4b26-ad0b-a085a563e419 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:36.779061 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4541a557-ffc3-4b26-ad0b-a085a563e419 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:36.779513 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4541a557-ffc3-4b26-ad0b-a085a563e419 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:36.914541 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4541a557-ffc3-4b26-ad0b-a085a563e419 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:36.923027 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4541a557-ffc3-4b26-ad0b-a085a563e419 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:36.924490 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4541a557-ffc3-4b26-ad0b-a085a563e419 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:36.925643 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4541a557-ffc3-4b26-ad0b-a085a563e419 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.159330 Sep 11 01:02:36.926198 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 425/861] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:02:36 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 01:02:37.583367 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1950702948", "imageRef": "07ab8e14-9feb-45cd-97af-959af877a1e7", "flavorRef": "452"}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:02:37.645486 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.network.neutron [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] validate_networks() for None {{(pid=120497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 01:02:37.923356 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Flavor limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 01:02:37.923779 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Image limits 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 01:02:37.924252 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Flavor pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 01:02:37.924660 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Image pref 0:0:0 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 01:02:37.925121 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.virt.hardware [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 01:02:37.934759 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:37.935218 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:37.935645 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:37.936372 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:37.936823 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:37.937248 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:37.950077 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-168b9260-f757-4b31-89cb-7178a201dd9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:37.950828 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-168b9260-f757-4b31-89cb-7178a201dd9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:37.954514 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Getting quotas for project eecf50e62b474fa1ae29cf0197bdefe7. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 01:02:37.957686 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-168b9260-f757-4b31-89cb-7178a201dd9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:37.958171 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-168b9260-f757-4b31-89cb-7178a201dd9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:37.958594 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-168b9260-f757-4b31-89cb-7178a201dd9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:37.958840 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Getting quotas for user 74cd83f1bed24ac48ea36b91613f021c and project eecf50e62b474fa1ae29cf0197bdefe7. Resources: {'instances', 'ram', 'cores'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 01:02:37.959312 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-168b9260-f757-4b31-89cb-7178a201dd9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:37.959761 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-168b9260-f757-4b31-89cb-7178a201dd9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:37.960165 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-168b9260-f757-4b31-89cb-7178a201dd9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:37.970262 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Going to run 1 instances... {{(pid=120497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 01:02:37.972721 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07ab8e14-9feb-45cd-97af-959af877a1e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 01:02:38.021182 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-e38b7b24-2aee-45ff-a0ef-a4547388c5db tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.442159 Sep 11 01:02:38.021968 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 437/862] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 01:02:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 01:02:38.032998 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-fff891fb-b3b4-41ae-b405-4c4963c2c6cb tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:38.033577 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-fff891fb-b3b4-41ae-b405-4c4963c2c6cb tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:38.363017 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-fff891fb-b3b4-41ae-b405-4c4963c2c6cb tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cd83f1bed24ac48ea36b91613f021c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecf50e62b474fa1ae29cf0197bdefe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:38.373734 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-fff891fb-b3b4-41ae-b405-4c4963c2c6cb tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 200 len: 1215 microversion: 2.1 time: 0.344422 Sep 11 01:02:38.374634 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 438/863] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:38 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 1215 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:38.386232 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-168b9260-f757-4b31-89cb-7178a201dd9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:38.394972 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-168b9260-f757-4b31-89cb-7178a201dd9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:38.396475 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-168b9260-f757-4b31-89cb-7178a201dd9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:38.397775 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-168b9260-f757-4b31-89cb-7178a201dd9e tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1720 microversion: 2.20 time: 0.451566 Sep 11 01:02:38.398219 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 426/864] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:02:37 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1720 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:02:39.385380 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-5a2bccf5-d206-48eb-beec-072dd467c240 req-0629e66f-9ee3-4bd3-999d-34f9f99253d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff12074-d8b0-4beb-9ddb-6e617f654908", "name": "network-vif-deleted", "tag": "e1f950b8-4e34-4132-8dba-e46621d7902f"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:02:39.398808 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2c4120cd-b4e4-4720-a890-7c8f0ca07201 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:39.401306 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2c4120cd-b4e4-4720-a890-7c8f0ca07201 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:39.425031 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-5a2bccf5-d206-48eb-beec-072dd467c240 req-0629e66f-9ee3-4bd3-999d-34f9f99253d7 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:39.425208 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c4120cd-b4e4-4720-a890-7c8f0ca07201 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:39.425518 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-5a2bccf5-d206-48eb-beec-072dd467c240 req-0629e66f-9ee3-4bd3-999d-34f9f99253d7 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:39.426717 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c4120cd-b4e4-4720-a890-7c8f0ca07201 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:39.427371 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c4120cd-b4e4-4720-a890-7c8f0ca07201 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:39.428822 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c4120cd-b4e4-4720-a890-7c8f0ca07201 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:39.431096 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c4120cd-b4e4-4720-a890-7c8f0ca07201 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:39.434501 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c4120cd-b4e4-4720-a890-7c8f0ca07201 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:39.435901 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-5a2bccf5-d206-48eb-beec-072dd467c240 req-0629e66f-9ee3-4bd3-999d-34f9f99253d7 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:39.455058 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-5a2bccf5-d206-48eb-beec-072dd467c240 req-0629e66f-9ee3-4bd3-999d-34f9f99253d7 service nova] Creating event network-vif-deleted:e1f950b8-4e34-4132-8dba-e46621d7902f for instance bff12074-d8b0-4beb-9ddb-6e617f654908 on hv-cinder-maste Sep 11 01:02:39.466968 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-5a2bccf5-d206-48eb-beec-072dd467c240 req-0629e66f-9ee3-4bd3-999d-34f9f99253d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088319 Sep 11 01:02:39.472046 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 439/865] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:02:39.490254 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f2c564c4-018e-4ce3-b6bc-5fd70d8bf748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:39.494168 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f2c564c4-018e-4ce3-b6bc-5fd70d8bf748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:39.503202 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2c564c4-018e-4ce3-b6bc-5fd70d8bf748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:39.503840 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2c564c4-018e-4ce3-b6bc-5fd70d8bf748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:39.504351 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2c564c4-018e-4ce3-b6bc-5fd70d8bf748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:39.505129 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2c564c4-018e-4ce3-b6bc-5fd70d8bf748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:39.505806 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2c564c4-018e-4ce3-b6bc-5fd70d8bf748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:39.506404 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f2c564c4-018e-4ce3-b6bc-5fd70d8bf748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:39.580411 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-2c4120cd-b4e4-4720-a890-7c8f0ca07201 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cd83f1bed24ac48ea36b91613f021c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecf50e62b474fa1ae29cf0197bdefe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:39.581524 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f2c564c4-018e-4ce3-b6bc-5fd70d8bf748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:39.590017 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2c4120cd-b4e4-4720-a890-7c8f0ca07201 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 200 len: 1273 microversion: 2.1 time: 0.197297 Sep 11 01:02:39.594741 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f2c564c4-018e-4ce3-b6bc-5fd70d8bf748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:39.596504 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-f2c564c4-018e-4ce3-b6bc-5fd70d8bf748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44c365d540894a908b34fe51d854e96e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf8c10e733e485f9ac63769727b7151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:39.601904 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f2c564c4-018e-4ce3-b6bc-5fd70d8bf748 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 200 len: 1364 microversion: 2.20 time: 0.128343 Sep 11 01:02:39.602821 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 427/866] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:39 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:02:39.615307 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 440/867] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:02:39 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 1364 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 01:02:40.628832 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-aff65499-9eca-46ab-af6d-f436a44d5661 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:40.629545 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-aff65499-9eca-46ab-af6d-f436a44d5661 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:40.629637 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c9a3f440-8e14-4504-bf0c-54a37e6ff37d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:40.630894 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c9a3f440-8e14-4504-bf0c-54a37e6ff37d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:40.638155 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9a3f440-8e14-4504-bf0c-54a37e6ff37d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:40.639149 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9a3f440-8e14-4504-bf0c-54a37e6ff37d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:40.639656 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-aff65499-9eca-46ab-af6d-f436a44d5661 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:40.639942 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9a3f440-8e14-4504-bf0c-54a37e6ff37d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:40.640413 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-aff65499-9eca-46ab-af6d-f436a44d5661 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:40.641035 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9a3f440-8e14-4504-bf0c-54a37e6ff37d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:40.641163 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-aff65499-9eca-46ab-af6d-f436a44d5661 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:40.641754 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9a3f440-8e14-4504-bf0c-54a37e6ff37d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:40.642290 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-aff65499-9eca-46ab-af6d-f436a44d5661 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:40.642493 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9a3f440-8e14-4504-bf0c-54a37e6ff37d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:40.642961 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-aff65499-9eca-46ab-af6d-f436a44d5661 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:40.643526 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-aff65499-9eca-46ab-af6d-f436a44d5661 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:40.668986 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-aff65499-9eca-46ab-af6d-f436a44d5661 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] HTTP exception thrown: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-aff65499-9eca-46ab-af6d-f436a44d5661 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Request method failure captured: Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 HTTP/1.1 Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTITt4T2abfRbSHNmV3mi1G_mltPD_SmXsVqGjT_oyfiTTuEpRzqwVCnltn5E8kEaDuMfnjUm_YRUTZcl2dqICbbszOPsNep-KuDpbVRIKHN-2x3z6qFFiAjbdYa1LDuw2Fq2ZpVdV6rnGOCcDXYQQv5M7me2xmd20agwuf3PHH1fXU Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 1bf8c10e733e485f9ac63769727b7151 Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:02:40.672468 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:02:40.674066 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1bf8c10e733e485f9ac63769727b7151", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:40.674066 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:40.674066 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 1bf8c10e733e485f9ac63769727b7151 Sep 11 01:02:40.674066 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:40.674066 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-AttachVolumeShelveTestJSON-279194813-project Sep 11 01:02:40.674066 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:02:40.674066 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:02:40.674066 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 44c365d540894a908b34fe51d854e96e Sep 11 01:02:40.674066 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-AttachVolumeShelveTestJSON-279194813-project Sep 11 01:02:40.674066 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 01:02:40.674066 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:40.674066 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': 'bff12074-d8b0-4beb-9ddb-6e617f654908'} Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:40.674860 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:40.676423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:40.679633 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-aff65499-9eca-46ab-af6d-f436a44d5661 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Returning 404 to user: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:40.683420 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-aff65499-9eca-46ab-af6d-f436a44d5661 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 404 len: 111 microversion: 2.20 time: 0.058292 Sep 11 01:02:40.684271 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 441/868] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:02:40 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 01:02:40.695431 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b2456763-eb0a-4f45-9916-7897674a9009 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '.version_select at 0x7fbb90575dc0>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:40.719691 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-b2456763-eb0a-4f45-9916-7897674a9009 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-123209165" status: 204 len: 0 microversion: 2.20 time: 0.028172 Sep 11 01:02:40.720880 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 442/869] 10.222.0.23 () {60 vars in 1259 bytes} [Sun Sep 11 01:02:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-123209165 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 01:02:40.884636 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c9a3f440-8e14-4504-bf0c-54a37e6ff37d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cd83f1bed24ac48ea36b91613f021c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecf50e62b474fa1ae29cf0197bdefe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:40.892999 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c9a3f440-8e14-4504-bf0c-54a37e6ff37d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 200 len: 1315 microversion: 2.1 time: 0.268020 Sep 11 01:02:40.894001 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 428/870] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:40 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:41.203854 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-2a2cfa7f-8f10-430d-a8f4-60fd3866d6df req-14c17e70-f815-4e23-8f1d-d135fb2c7c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12275e3-a215-4bde-a179-8b6a11c454ef", "tag": "f1040f65-cbe2-4b9d-b317-34c547e8ee83"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:02:41.214592 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-2a2cfa7f-8f10-430d-a8f4-60fd3866d6df req-14c17e70-f815-4e23-8f1d-d135fb2c7c48 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:41.215099 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-2a2cfa7f-8f10-430d-a8f4-60fd3866d6df req-14c17e70-f815-4e23-8f1d-d135fb2c7c48 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:41.215579 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-2a2cfa7f-8f10-430d-a8f4-60fd3866d6df req-14c17e70-f815-4e23-8f1d-d135fb2c7c48 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:41.226572 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-2a2cfa7f-8f10-430d-a8f4-60fd3866d6df req-14c17e70-f815-4e23-8f1d-d135fb2c7c48 service nova] Creating event network-changed:f1040f65-cbe2-4b9d-b317-34c547e8ee83 for instance a12275e3-a215-4bde-a179-8b6a11c454ef on hv-cinder-maste Sep 11 01:02:41.231346 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-2a2cfa7f-8f10-430d-a8f4-60fd3866d6df req-14c17e70-f815-4e23-8f1d-d135fb2c7c48 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032061 Sep 11 01:02:41.231939 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 443/871] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:02:41.924241 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c9d708d1-d391-4374-bef9-c76ffda5cadc tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:41.925273 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c9d708d1-d391-4374-bef9-c76ffda5cadc tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:41.936167 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9d708d1-d391-4374-bef9-c76ffda5cadc tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:41.937095 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9d708d1-d391-4374-bef9-c76ffda5cadc tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:41.937516 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9d708d1-d391-4374-bef9-c76ffda5cadc tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:41.938214 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9d708d1-d391-4374-bef9-c76ffda5cadc tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:41.938682 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9d708d1-d391-4374-bef9-c76ffda5cadc tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:41.939101 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9d708d1-d391-4374-bef9-c76ffda5cadc tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:42.073582 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c9d708d1-d391-4374-bef9-c76ffda5cadc tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cd83f1bed24ac48ea36b91613f021c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecf50e62b474fa1ae29cf0197bdefe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:42.084761 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c9d708d1-d391-4374-bef9-c76ffda5cadc tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 200 len: 1315 microversion: 2.1 time: 0.166846 Sep 11 01:02:42.085481 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 429/872] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:41 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:42.547262 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5ca29e20-ad9d-4d5b-8f75-2efae5283a08 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:42.548403 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-5ca29e20-ad9d-4d5b-8f75-2efae5283a08 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:42.554901 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ca29e20-ad9d-4d5b-8f75-2efae5283a08 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:42.555833 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ca29e20-ad9d-4d5b-8f75-2efae5283a08 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:42.556454 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ca29e20-ad9d-4d5b-8f75-2efae5283a08 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:42.557125 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ca29e20-ad9d-4d5b-8f75-2efae5283a08 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:42.557734 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ca29e20-ad9d-4d5b-8f75-2efae5283a08 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:42.558302 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-5ca29e20-ad9d-4d5b-8f75-2efae5283a08 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:42.573629 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-5ca29e20-ad9d-4d5b-8f75-2efae5283a08 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] HTTP exception thrown: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5ca29e20-ad9d-4d5b-8f75-2efae5283a08 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Request method failure captured: Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: DELETE /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 HTTP/1.1 Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTITt4T2abfRbSHNmV3mi1G_mltPD_SmXsVqGjT_oyfiTTuEpRzqwVCnltn5E8kEaDuMfnjUm_YRUTZcl2dqICbbszOPsNep-KuDpbVRIKHN-2x3z6qFFiAjbdYa1LDuw2Fq2ZpVdV6rnGOCcDXYQQv5M7me2xmd20agwuf3PHH1fXU Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 1bf8c10e733e485f9ac63769727b7151 Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:02:42.575358 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:02:42.577024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1bf8c10e733e485f9ac63769727b7151", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:42.577024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:42.577024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 1bf8c10e733e485f9ac63769727b7151 Sep 11 01:02:42.577024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:42.577024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-AttachVolumeShelveTestJSON-279194813-project Sep 11 01:02:42.577024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:02:42.577024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:02:42.577024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 44c365d540894a908b34fe51d854e96e Sep 11 01:02:42.577024 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-AttachVolumeShelveTestJSON-279194813-project Sep 11 01:02:42.577024 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 01:02:42.577024 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:42.577024 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': 'bff12074-d8b0-4beb-9ddb-6e617f654908'} Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:42.577883 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:42.579496 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:42.581079 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5ca29e20-ad9d-4d5b-8f75-2efae5283a08 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Returning 404 to user: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:42.581079 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-5ca29e20-ad9d-4d5b-8f75-2efae5283a08 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 404 len: 111 microversion: 2.20 time: 0.034760 Sep 11 01:02:42.581079 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 444/873] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Sep 11 01:02:42 2022] DELETE /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 01:02:42.586252 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-66fb55b7-6b2a-4a2c-a50d-bb053f40b937 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:42.587336 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-66fb55b7-6b2a-4a2c-a50d-bb053f40b937 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: bff12074-d8b0-4beb-9ddb-6e617f654908] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:42.593706 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66fb55b7-6b2a-4a2c-a50d-bb053f40b937 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:42.594188 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66fb55b7-6b2a-4a2c-a50d-bb053f40b937 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:42.594832 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66fb55b7-6b2a-4a2c-a50d-bb053f40b937 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:42.595950 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66fb55b7-6b2a-4a2c-a50d-bb053f40b937 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:42.596044 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66fb55b7-6b2a-4a2c-a50d-bb053f40b937 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:42.597114 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-66fb55b7-6b2a-4a2c-a50d-bb053f40b937 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:42.617971 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-66fb55b7-6b2a-4a2c-a50d-bb053f40b937 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] HTTP exception thrown: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-66fb55b7-6b2a-4a2c-a50d-bb053f40b937 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Request method failure captured: Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 HTTP/1.1 Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTITt4T2abfRbSHNmV3mi1G_mltPD_SmXsVqGjT_oyfiTTuEpRzqwVCnltn5E8kEaDuMfnjUm_YRUTZcl2dqICbbszOPsNep-KuDpbVRIKHN-2x3z6qFFiAjbdYa1LDuw2Fq2ZpVdV6rnGOCcDXYQQv5M7me2xmd20agwuf3PHH1fXU Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 1bf8c10e733e485f9ac63769727b7151 Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:02:42.620183 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:02:42.621904 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1bf8c10e733e485f9ac63769727b7151", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:42.621904 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:42.621904 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 1bf8c10e733e485f9ac63769727b7151 Sep 11 01:02:42.621904 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:42.621904 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-AttachVolumeShelveTestJSON-279194813-project Sep 11 01:02:42.621904 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:02:42.621904 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:02:42.621904 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 44c365d540894a908b34fe51d854e96e Sep 11 01:02:42.621904 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeShelveTestJSON-279194813-project Sep 11 01:02:42.621904 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:02:42.621904 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:42.621904 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': 'bff12074-d8b0-4beb-9ddb-6e617f654908'} Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:42.622820 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. Sep 11 01:02:42.624396 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:42.625597 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-66fb55b7-6b2a-4a2c-a50d-bb053f40b937 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Returning 404 to user: Instance bff12074-d8b0-4beb-9ddb-6e617f654908 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:42.625597 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-66fb55b7-6b2a-4a2c-a50d-bb053f40b937 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908" status: 404 len: 111 microversion: 2.20 time: 0.039423 Sep 11 01:02:42.625597 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 430/874] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:02:42 2022] GET /compute/v2.1/servers/bff12074-d8b0-4beb-9ddb-6e617f654908 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 01:02:43.110570 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6871b81a-94ac-4074-88ad-8bdace2c7c99 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:43.111208 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-6871b81a-94ac-4074-88ad-8bdace2c7c99 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:43.117277 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6871b81a-94ac-4074-88ad-8bdace2c7c99 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:43.117766 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6871b81a-94ac-4074-88ad-8bdace2c7c99 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:43.118198 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6871b81a-94ac-4074-88ad-8bdace2c7c99 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:43.118885 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6871b81a-94ac-4074-88ad-8bdace2c7c99 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:43.119366 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6871b81a-94ac-4074-88ad-8bdace2c7c99 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:43.119786 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-6871b81a-94ac-4074-88ad-8bdace2c7c99 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:43.256150 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-6871b81a-94ac-4074-88ad-8bdace2c7c99 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cd83f1bed24ac48ea36b91613f021c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecf50e62b474fa1ae29cf0197bdefe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:43.264118 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6871b81a-94ac-4074-88ad-8bdace2c7c99 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 200 len: 1315 microversion: 2.1 time: 0.157549 Sep 11 01:02:43.264731 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 445/875] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:43 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:43.781716 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bcd6bce9-557d-4541-ae3b-16f2ff659e8f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:43.782277 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bcd6bce9-557d-4541-ae3b-16f2ff659e8f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:43.791625 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bcd6bce9-557d-4541-ae3b-16f2ff659e8f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:43.792436 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bcd6bce9-557d-4541-ae3b-16f2ff659e8f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:43.793156 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bcd6bce9-557d-4541-ae3b-16f2ff659e8f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:43.794355 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bcd6bce9-557d-4541-ae3b-16f2ff659e8f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:43.795065 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bcd6bce9-557d-4541-ae3b-16f2ff659e8f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:43.795723 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bcd6bce9-557d-4541-ae3b-16f2ff659e8f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:43.812965 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-bcd6bce9-557d-4541-ae3b-16f2ff659e8f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] HTTP exception thrown: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bcd6bce9-557d-4541-ae3b-16f2ff659e8f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Request method failure captured: Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: DELETE /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 HTTP/1.1 Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTITt4T2abfRbSHNmV3mi1G_mltPD_SmXsVqGjT_oyfiTTuEpRzqwVCnltn5E8kEaDuMfnjUm_YRUTZcl2dqICbbszOPsNep-KuDpbVRIKHN-2x3z6qFFiAjbdYa1LDuw2Fq2ZpVdV6rnGOCcDXYQQv5M7me2xmd20agwuf3PHH1fXU Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 1bf8c10e733e485f9ac63769727b7151 Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:02:43.814573 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:02:43.816424 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1bf8c10e733e485f9ac63769727b7151", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:43.816424 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:43.816424 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 1bf8c10e733e485f9ac63769727b7151 Sep 11 01:02:43.816424 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:43.816424 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-AttachVolumeShelveTestJSON-279194813-project Sep 11 01:02:43.816424 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:02:43.816424 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:02:43.816424 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: 44c365d540894a908b34fe51d854e96e Sep 11 01:02:43.816424 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeShelveTestJSON-279194813-project Sep 11 01:02:43.816424 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:02:43.816424 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 01:02:43.816424 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': '185afbdf-74f7-4a54-8ba8-58e7b6fd2e73'} Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:43.817276 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 01:02:43.818544 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:43.819867 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bcd6bce9-557d-4541-ae3b-16f2ff659e8f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Returning 404 to user: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:43.819867 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bcd6bce9-557d-4541-ae3b-16f2ff659e8f tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "DELETE /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 404 len: 111 microversion: 2.20 time: 0.038360 Sep 11 01:02:43.819867 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 431/876] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Sep 11 01:02:43 2022] DELETE /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 01:02:43.824746 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-594e3554-8caa-45cb-969c-cc713b078961 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:43.825346 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-594e3554-8caa-45cb-969c-cc713b078961 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] [instance: 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:43.832071 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-594e3554-8caa-45cb-969c-cc713b078961 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:43.832507 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-594e3554-8caa-45cb-969c-cc713b078961 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:43.833092 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-594e3554-8caa-45cb-969c-cc713b078961 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:43.833964 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-594e3554-8caa-45cb-969c-cc713b078961 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:43.834404 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-594e3554-8caa-45cb-969c-cc713b078961 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:43.834814 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-594e3554-8caa-45cb-969c-cc713b078961 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:44.003253 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-594e3554-8caa-45cb-969c-cc713b078961 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] HTTP exception thrown: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-594e3554-8caa-45cb-969c-cc713b078961 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Request method failure captured: Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 HTTP/1.1 Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTITt4T2abfRbSHNmV3mi1G_mltPD_SmXsVqGjT_oyfiTTuEpRzqwVCnltn5E8kEaDuMfnjUm_YRUTZcl2dqICbbszOPsNep-KuDpbVRIKHN-2x3z6qFFiAjbdYa1LDuw2Fq2ZpVdV6rnGOCcDXYQQv5M7me2xmd20agwuf3PHH1fXU Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 1bf8c10e733e485f9ac63769727b7151 Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:02:44.004728 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:02:44.006502 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1bf8c10e733e485f9ac63769727b7151"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1bf8c10e733e485f9ac63769727b7151", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:44.006502 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:44.006502 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 1bf8c10e733e485f9ac63769727b7151 Sep 11 01:02:44.006502 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-279194813 Sep 11 01:02:44.006502 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-AttachVolumeShelveTestJSON-279194813-project Sep 11 01:02:44.006502 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:02:44.006502 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:02:44.006502 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 44c365d540894a908b34fe51d854e96e Sep 11 01:02:44.006502 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-AttachVolumeShelveTestJSON-279194813-project Sep 11 01:02:44.006502 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 01:02:44.006502 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 01:02:44.006502 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': '185afbdf-74f7-4a54-8ba8-58e7b6fd2e73'} Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:44.007938 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. Sep 11 01:02:44.010412 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:44.012871 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-594e3554-8caa-45cb-969c-cc713b078961 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] Returning 404 to user: Instance 185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:44.012871 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-594e3554-8caa-45cb-969c-cc713b078961 tempest-AttachVolumeShelveTestJSON-279194813 tempest-AttachVolumeShelveTestJSON-279194813-project] 10.222.0.23 "GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73" status: 404 len: 111 microversion: 2.20 time: 0.185223 Sep 11 01:02:44.012871 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 446/877] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Sep 11 01:02:43 2022] GET /compute/v2.1/servers/185afbdf-74f7-4a54-8ba8-58e7b6fd2e73 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 01:02:44.287597 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8695d13c-ee58-4838-a10e-facf1682eff8 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:44.288209 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8695d13c-ee58-4838-a10e-facf1682eff8 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:44.294611 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8695d13c-ee58-4838-a10e-facf1682eff8 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:44.295085 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8695d13c-ee58-4838-a10e-facf1682eff8 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:44.295538 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8695d13c-ee58-4838-a10e-facf1682eff8 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:44.296226 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8695d13c-ee58-4838-a10e-facf1682eff8 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:44.296672 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8695d13c-ee58-4838-a10e-facf1682eff8 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:44.297089 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8695d13c-ee58-4838-a10e-facf1682eff8 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:44.437360 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8695d13c-ee58-4838-a10e-facf1682eff8 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cd83f1bed24ac48ea36b91613f021c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecf50e62b474fa1ae29cf0197bdefe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:44.446861 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8695d13c-ee58-4838-a10e-facf1682eff8 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 200 len: 1315 microversion: 2.1 time: 0.163538 Sep 11 01:02:44.447685 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 432/878] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:44 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:45.470403 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-297e2b54-0476-4b2a-9fe1-f606403e771f tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:45.471119 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-297e2b54-0476-4b2a-9fe1-f606403e771f tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:45.478658 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-297e2b54-0476-4b2a-9fe1-f606403e771f tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:45.479124 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-297e2b54-0476-4b2a-9fe1-f606403e771f tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:45.479579 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-297e2b54-0476-4b2a-9fe1-f606403e771f tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:45.480285 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-297e2b54-0476-4b2a-9fe1-f606403e771f tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:45.480732 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-297e2b54-0476-4b2a-9fe1-f606403e771f tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:45.481149 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-297e2b54-0476-4b2a-9fe1-f606403e771f tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:45.623840 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-297e2b54-0476-4b2a-9fe1-f606403e771f tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cd83f1bed24ac48ea36b91613f021c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecf50e62b474fa1ae29cf0197bdefe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:45.632347 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-297e2b54-0476-4b2a-9fe1-f606403e771f tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 200 len: 1315 microversion: 2.1 time: 0.165918 Sep 11 01:02:45.639641 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 447/879] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:45 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:46.655512 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fb6b308c-5790-49c8-9287-42a6b97c4bba tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:46.656211 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-fb6b308c-5790-49c8-9287-42a6b97c4bba tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:46.663427 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fb6b308c-5790-49c8-9287-42a6b97c4bba tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:46.664005 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fb6b308c-5790-49c8-9287-42a6b97c4bba tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:46.664514 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fb6b308c-5790-49c8-9287-42a6b97c4bba tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:46.665441 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fb6b308c-5790-49c8-9287-42a6b97c4bba tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:46.665962 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fb6b308c-5790-49c8-9287-42a6b97c4bba tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:46.666518 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fb6b308c-5790-49c8-9287-42a6b97c4bba tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:46.825203 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-fb6b308c-5790-49c8-9287-42a6b97c4bba tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cd83f1bed24ac48ea36b91613f021c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecf50e62b474fa1ae29cf0197bdefe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:46.846218 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-fb6b308c-5790-49c8-9287-42a6b97c4bba tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 200 len: 1315 microversion: 2.1 time: 0.194555 Sep 11 01:02:46.854149 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 433/880] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:46 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:47.871073 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-40a6092d-2661-4f87-86c1-4bc9969f8266 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:47.871789 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-40a6092d-2661-4f87-86c1-4bc9969f8266 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:47.878426 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-40a6092d-2661-4f87-86c1-4bc9969f8266 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:47.878909 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-40a6092d-2661-4f87-86c1-4bc9969f8266 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:47.879436 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-40a6092d-2661-4f87-86c1-4bc9969f8266 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:47.880328 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-40a6092d-2661-4f87-86c1-4bc9969f8266 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:47.880912 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-40a6092d-2661-4f87-86c1-4bc9969f8266 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:47.881358 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-40a6092d-2661-4f87-86c1-4bc9969f8266 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:47.944962 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=2 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:48.018786 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-40a6092d-2661-4f87-86c1-4bc9969f8266 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cd83f1bed24ac48ea36b91613f021c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecf50e62b474fa1ae29cf0197bdefe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:48.027203 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-40a6092d-2661-4f87-86c1-4bc9969f8266 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 200 len: 1315 microversion: 2.1 time: 0.160035 Sep 11 01:02:48.027848 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 448/881] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:47 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:48.223971 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-e7c099bd-d6dc-4110-8091-8e5b5c1b804c req-4949201b-8515-47b4-99b1-50e231d06154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12275e3-a215-4bde-a179-8b6a11c454ef", "name": "network-vif-plugged", "status": "completed", "tag": "f1040f65-cbe2-4b9d-b317-34c547e8ee83"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:02:48.234875 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-e7c099bd-d6dc-4110-8091-8e5b5c1b804c req-4949201b-8515-47b4-99b1-50e231d06154 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:48.235813 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-e7c099bd-d6dc-4110-8091-8e5b5c1b804c req-4949201b-8515-47b4-99b1-50e231d06154 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:48.236242 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-e7c099bd-d6dc-4110-8091-8e5b5c1b804c req-4949201b-8515-47b4-99b1-50e231d06154 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:48.247713 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-e7c099bd-d6dc-4110-8091-8e5b5c1b804c req-4949201b-8515-47b4-99b1-50e231d06154 service nova] Creating event network-vif-plugged:f1040f65-cbe2-4b9d-b317-34c547e8ee83 for instance a12275e3-a215-4bde-a179-8b6a11c454ef on hv-cinder-maste Sep 11 01:02:48.252862 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-e7c099bd-d6dc-4110-8091-8e5b5c1b804c req-4949201b-8515-47b4-99b1-50e231d06154 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032949 Sep 11 01:02:48.253688 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 434/882] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:02:48.535220 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=8 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:48.653200 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0e9ffa00-8d56-4daa-917f-117c7c209062 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Action: 'create', calling method: .version_select at 0x7fbb90529430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-202145155"}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:02:48.967125 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0e9ffa00-8d56-4daa-917f-117c7c209062 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.436445 Sep 11 01:02:48.967828 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 449/883] 10.222.0.23 () {60 vars in 1155 bytes} [Sun Sep 11 01:02:48 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 438 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 11 01:02:48.981437 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8391fee8-bd38-4bc6-87d6-695bf5e301de tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Calling method '.version_select at 0x7fbb90696700>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:49.031829 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8391fee8-bd38-4bc6-87d6-695bf5e301de tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3" status: 200 len: 344 microversion: 2.1 time: 0.054443 Sep 11 01:02:49.032632 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 435/884] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Sep 11 01:02:48 2022] GET /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:02:49.050390 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-73c4daeb-5048-4699-8e68-e12cda407d71 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:49.050999 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-73c4daeb-5048-4699-8e68-e12cda407d71 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:49.057731 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-73c4daeb-5048-4699-8e68-e12cda407d71 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:49.058208 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-73c4daeb-5048-4699-8e68-e12cda407d71 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:49.058638 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-73c4daeb-5048-4699-8e68-e12cda407d71 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:49.059393 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-73c4daeb-5048-4699-8e68-e12cda407d71 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:49.059841 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-73c4daeb-5048-4699-8e68-e12cda407d71 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:49.060259 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-73c4daeb-5048-4699-8e68-e12cda407d71 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:49.190730 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-73c4daeb-5048-4699-8e68-e12cda407d71 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cd83f1bed24ac48ea36b91613f021c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecf50e62b474fa1ae29cf0197bdefe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:49.198800 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-73c4daeb-5048-4699-8e68-e12cda407d71 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 200 len: 1315 microversion: 2.1 time: 0.152372 Sep 11 01:02:49.199387 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 450/885] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:49 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:50.048822 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-827e9b71-06ac-40a3-ab0a-ce674b156bb1 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Calling method '.version_select at 0x7fbb906b4160>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:50.105007 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-827e9b71-06ac-40a3-ab0a-ce674b156bb1 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3" status: 200 len: 345 microversion: 2.1 time: 0.061611 Sep 11 01:02:50.105578 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 436/886] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Sep 11 01:02:50 2022] GET /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:02:50.118659 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a77a73ae-6aef-4453-97a7-075272ec75f4 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Action: 'create', calling method: .version_select at 0x7fbb905294c0>, body: {"snapshot": {"volume_id": "35d4aeab-e272-49ed-bcbf-46b0770651e3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-20578218"}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:02:50.222189 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3bd2f79b-f8f8-4ce0-9d96-d5ef32045a26 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:50.222919 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3bd2f79b-f8f8-4ce0-9d96-d5ef32045a26 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:50.230994 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3bd2f79b-f8f8-4ce0-9d96-d5ef32045a26 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:50.231627 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3bd2f79b-f8f8-4ce0-9d96-d5ef32045a26 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:50.232373 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3bd2f79b-f8f8-4ce0-9d96-d5ef32045a26 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:50.233110 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3bd2f79b-f8f8-4ce0-9d96-d5ef32045a26 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:50.233558 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3bd2f79b-f8f8-4ce0-9d96-d5ef32045a26 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:50.234081 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3bd2f79b-f8f8-4ce0-9d96-d5ef32045a26 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:50.308965 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a77a73ae-6aef-4453-97a7-075272ec75f4 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.194108 Sep 11 01:02:50.309766 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 451/887] 10.222.0.23 () {60 vars in 1162 bytes} [Sun Sep 11 01:02:50 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:02:50.322836 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c24d7fb9-d023-470c-8574-19cd475c9537 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Calling method '.version_select at 0x7fbb9054c8b0>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:50.354818 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c24d7fb9-d023-470c-8574-19cd475c9537 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4" status: 200 len: 285 microversion: 2.1 time: 0.037137 Sep 11 01:02:50.355522 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 452/888] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Sep 11 01:02:50 2022] GET /compute/v2.1/os-snapshots/c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4 => generated 285 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:02:50.366755 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-4389d087-649d-40b7-a059-288e077ec1cd tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Calling method '.version_select at 0x7fbb905b98b0>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:50.399209 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-4389d087-649d-40b7-a059-288e077ec1cd tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.036257 Sep 11 01:02:50.399773 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 453/889] 10.222.0.23 () {58 vars in 1140 bytes} [Sun Sep 11 01:02:50 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:02:50.411042 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-6a77baa6-56dc-48a0-9521-f48d773c3ca1 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Calling method '.version_select at 0x7fbb90529f70>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:50.424029 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-3bd2f79b-f8f8-4ce0-9d96-d5ef32045a26 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cd83f1bed24ac48ea36b91613f021c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecf50e62b474fa1ae29cf0197bdefe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:50.438636 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3bd2f79b-f8f8-4ce0-9d96-d5ef32045a26 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 200 len: 1464 microversion: 2.1 time: 0.220280 Sep 11 01:02:50.445227 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-6a77baa6-56dc-48a0-9521-f48d773c3ca1 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4" status: 200 len: 285 microversion: 2.1 time: 0.037977 Sep 11 01:02:50.446009 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 454/890] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Sep 11 01:02:50 2022] GET /compute/v2.1/os-snapshots/c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4 => generated 285 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:02:50.452145 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 437/891] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:50 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 1464 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 01:02:50.488932 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-b4321810-0f78-45ce-a385-ed8c87b8b7cf tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:50.489684 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-b4321810-0f78-45ce-a385-ed8c87b8b7cf tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:50.496153 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b4321810-0f78-45ce-a385-ed8c87b8b7cf tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:50.496670 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b4321810-0f78-45ce-a385-ed8c87b8b7cf tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:50.497068 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b4321810-0f78-45ce-a385-ed8c87b8b7cf tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:50.497762 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b4321810-0f78-45ce-a385-ed8c87b8b7cf tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:50.498195 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b4321810-0f78-45ce-a385-ed8c87b8b7cf tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:50.498819 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-b4321810-0f78-45ce-a385-ed8c87b8b7cf tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:50.525093 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-b4321810-0f78-45ce-a385-ed8c87b8b7cf tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Going to try to terminate instance {{(pid=120497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 01:02:50.611827 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-b4321810-0f78-45ce-a385-ed8c87b8b7cf tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 204 len: 0 microversion: 2.1 time: 0.126116 Sep 11 01:02:50.612463 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 455/892] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:02:50 2022] DELETE /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 01:02:50.621152 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-924184d9-8e07-4ee8-9a18-7299e0bdacd9 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:50.621878 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-924184d9-8e07-4ee8-9a18-7299e0bdacd9 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:50.628948 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-924184d9-8e07-4ee8-9a18-7299e0bdacd9 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:50.629354 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-924184d9-8e07-4ee8-9a18-7299e0bdacd9 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:50.629788 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-924184d9-8e07-4ee8-9a18-7299e0bdacd9 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:50.630500 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-924184d9-8e07-4ee8-9a18-7299e0bdacd9 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:50.630952 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-924184d9-8e07-4ee8-9a18-7299e0bdacd9 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:50.631416 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-924184d9-8e07-4ee8-9a18-7299e0bdacd9 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:50.777834 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-924184d9-8e07-4ee8-9a18-7299e0bdacd9 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cd83f1bed24ac48ea36b91613f021c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecf50e62b474fa1ae29cf0197bdefe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:50.786953 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-924184d9-8e07-4ee8-9a18-7299e0bdacd9 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 200 len: 1470 microversion: 2.1 time: 0.169448 Sep 11 01:02:50.787602 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 438/893] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:50 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:51.458570 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-9b8199e3-d988-48cc-a5cf-78ea20d91652 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Calling method '.version_select at 0x7fbb905a6040>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:51.489854 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-9b8199e3-d988-48cc-a5cf-78ea20d91652 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4" status: 200 len: 286 microversion: 2.1 time: 0.035437 Sep 11 01:02:51.490557 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 456/894] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Sep 11 01:02:51 2022] GET /compute/v2.1/os-snapshots/c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:02:51.501854 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-31a0ad64-a316-4cb0-9c17-c110fd44935a tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Calling method '.version_select at 0x7fbb90620b80>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:51.565799 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-31a0ad64-a316-4cb0-9c17-c110fd44935a tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4" status: 202 len: 0 microversion: 2.1 time: 0.067765 Sep 11 01:02:51.566528 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 439/895] 10.222.0.23 () {58 vars in 1254 bytes} [Sun Sep 11 01:02:51 2022] DELETE /compute/v2.1/os-snapshots/c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:02:51.574864 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-c6f2a7df-f61d-4b55-a32f-b7823edbb0b7 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Calling method '.version_select at 0x7fbb905c6160>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:51.604935 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-c6f2a7df-f61d-4b55-a32f-b7823edbb0b7 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4" status: 200 len: 285 microversion: 2.1 time: 0.034161 Sep 11 01:02:51.606330 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 457/896] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Sep 11 01:02:51 2022] GET /compute/v2.1/os-snapshots/c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4 => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:02:51.811849 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9d17b9e1-1060-413b-be6f-06a509befa0d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:51.812609 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9d17b9e1-1060-413b-be6f-06a509befa0d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:51.818945 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d17b9e1-1060-413b-be6f-06a509befa0d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:51.819534 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d17b9e1-1060-413b-be6f-06a509befa0d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:51.820000 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d17b9e1-1060-413b-be6f-06a509befa0d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:51.820733 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d17b9e1-1060-413b-be6f-06a509befa0d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:51.821198 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d17b9e1-1060-413b-be6f-06a509befa0d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:51.821574 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d17b9e1-1060-413b-be6f-06a509befa0d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:51.959866 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-9d17b9e1-1060-413b-be6f-06a509befa0d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cd83f1bed24ac48ea36b91613f021c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecf50e62b474fa1ae29cf0197bdefe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:51.967463 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9d17b9e1-1060-413b-be6f-06a509befa0d tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 200 len: 1470 microversion: 2.1 time: 0.161370 Sep 11 01:02:51.968000 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 440/897] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:51 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:52.619554 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5ee13b4e-feed-49c3-8365-48a902861c75 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Calling method '.version_select at 0x7fbb905c68b0>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:52.645780 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-5ee13b4e-feed-49c3-8365-48a902861c75 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] HTTP exception thrown: Snapshot c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4 could not be found. Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5ee13b4e-feed-49c3-8365-48a902861c75 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Request method failure captured: Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/os-snapshots/c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4 HTTP/1.1 Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTO4H7IEGXpc0MakJIAnChN0GUKoYOsomf4CnbgIVYFeEhUDmsYFv0otwsW_CZ26YTeWXQITK5isRCyP3DUexR54RNE_d1HXXQCPJoeVWK67UtRphtpa-urVjoVy9rm-WpsY6nXEGjI7gQljFpnmA3hNKj9iwemfXHfQBnMIJHKVoBw Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 5d8fe9c1759f4b52b83110351d2a31eb Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2011293665 Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:02:52.663920 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:02:52.665430 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8fe9c1759f4b52b83110351d2a31eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8fe9c1759f4b52b83110351d2a31eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d8fe9c1759f4b52b83110351d2a31eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d8fe9c1759f4b52b83110351d2a31eb", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:52.665430 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2011293665 Sep 11 01:02:52.665430 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 5d8fe9c1759f4b52b83110351d2a31eb Sep 11 01:02:52.665430 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2011293665 Sep 11 01:02:52.665430 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-VolumesSnapshotsTestJSON-2011293665-project Sep 11 01:02:52.665430 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:02:52.665430 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:02:52.665430 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: fbbbcaddfb6a48efa43629988623cdb9 Sep 11 01:02:52.665430 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2011293665-project Sep 11 01:02:52.665430 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: Sep 11 01:02:52.665430 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Snapshot c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4 could not be found. Sep 11 01:02:52.665430 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': 'c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4'} Sep 11 01:02:52.665430 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4 could not be found. (HTTP 404) (Request-ID: req-6eedb4ed-474c-4272-b302-00850aafeb9f) Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:52.666325 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 01:02:52.668153 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4 could not be found. Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 11 01:02:52.669651 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:52.672681 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4 could not be found. Sep 11 01:02:52.672681 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:52.672681 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:52.672681 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:52.672681 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:52.672681 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:52.672681 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:52.672681 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:52.672681 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:52.672681 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4 could not be found. Sep 11 01:02:52.672681 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:52.676634 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-5ee13b4e-feed-49c3-8365-48a902861c75 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Returning 404 to user: Snapshot c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:52.677827 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-5ee13b4e-feed-49c3-8365-48a902861c75 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4" status: 404 len: 111 microversion: 2.1 time: 0.063691 Sep 11 01:02:52.679291 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 458/898] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Sep 11 01:02:52 2022] GET /compute/v2.1/os-snapshots/c03a9d9f-57c8-46a9-9e8d-da4c2f69b4e4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:02:52.693623 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3574f73a-7523-4920-a994-a036a0997160 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Calling method '.version_select at 0x7fbb90696310>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:52.730071 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-946f2011-08fa-4d44-99db-3ddbca177518 req-09cf84ce-ef0e-426c-8da9-dc75ce7aee68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12275e3-a215-4bde-a179-8b6a11c454ef", "name": "network-vif-deleted", "tag": "f1040f65-cbe2-4b9d-b317-34c547e8ee83"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:02:52.742937 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-946f2011-08fa-4d44-99db-3ddbca177518 req-09cf84ce-ef0e-426c-8da9-dc75ce7aee68 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:52.743420 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-946f2011-08fa-4d44-99db-3ddbca177518 req-09cf84ce-ef0e-426c-8da9-dc75ce7aee68 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:52.744380 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-946f2011-08fa-4d44-99db-3ddbca177518 req-09cf84ce-ef0e-426c-8da9-dc75ce7aee68 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:52.765221 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-946f2011-08fa-4d44-99db-3ddbca177518 req-09cf84ce-ef0e-426c-8da9-dc75ce7aee68 service nova] Creating event network-vif-deleted:f1040f65-cbe2-4b9d-b317-34c547e8ee83 for instance a12275e3-a215-4bde-a179-8b6a11c454ef on hv-cinder-maste Sep 11 01:02:52.773989 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-946f2011-08fa-4d44-99db-3ddbca177518 req-09cf84ce-ef0e-426c-8da9-dc75ce7aee68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047153 Sep 11 01:02:52.774565 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 459/899] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:02:52.776651 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3574f73a-7523-4920-a994-a036a0997160 tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3" status: 202 len: 0 microversion: 2.1 time: 0.092652 Sep 11 01:02:52.777518 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 441/900] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Sep 11 01:02:52 2022] DELETE /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:02:52.785926 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fa1f6669-283a-4c76-b200-4db4d3ddec4a tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Calling method '.version_select at 0x7fbb90693e50>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:52.862582 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-fa1f6669-283a-4c76-b200-4db4d3ddec4a tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3" status: 200 len: 344 microversion: 2.1 time: 0.080921 Sep 11 01:02:52.863214 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 442/901] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Sep 11 01:02:52 2022] GET /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:02:52.991638 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-555c188e-bb16-40c2-8949-b30f3cf33815 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:52.992458 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-555c188e-bb16-40c2-8949-b30f3cf33815 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:53.000266 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-555c188e-bb16-40c2-8949-b30f3cf33815 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:53.000818 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-555c188e-bb16-40c2-8949-b30f3cf33815 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:53.001601 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-555c188e-bb16-40c2-8949-b30f3cf33815 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:53.002368 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-555c188e-bb16-40c2-8949-b30f3cf33815 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:53.002885 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-555c188e-bb16-40c2-8949-b30f3cf33815 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:53.003603 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-555c188e-bb16-40c2-8949-b30f3cf33815 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:53.039988 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-555c188e-bb16-40c2-8949-b30f3cf33815 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:53.040461 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-555c188e-bb16-40c2-8949-b30f3cf33815 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:53.040887 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-555c188e-bb16-40c2-8949-b30f3cf33815 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:53.041321 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-555c188e-bb16-40c2-8949-b30f3cf33815 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lazy-loading 'fault' on Instance uuid a12275e3-a215-4bde-a179-8b6a11c454ef {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:02:53.087614 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-555c188e-bb16-40c2-8949-b30f3cf33815 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cd83f1bed24ac48ea36b91613f021c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eecf50e62b474fa1ae29cf0197bdefe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:02:53.097478 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-555c188e-bb16-40c2-8949-b30f3cf33815 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 200 len: 1305 microversion: 2.1 time: 0.110644 Sep 11 01:02:53.098208 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 460/902] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:52 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:02:53.881802 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6865dd50-a2e4-4579-a030-648171dba60f tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Calling method '.version_select at 0x7fbb906c2430>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:53.921562 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-6865dd50-a2e4-4579-a030-648171dba60f tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] HTTP exception thrown: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6865dd50-a2e4-4579-a030-648171dba60f tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Request method failure captured: Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3 HTTP/1.1 Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTO4H7IEGXpc0MakJIAnChN0GUKoYOsomf4CnbgIVYFeEhUDmsYFv0otwsW_CZ26YTeWXQITK5isRCyP3DUexR54RNE_d1HXXQCPJoeVWK67UtRphtpa-urVjoVy9rm-WpsY6nXEGjI7gQljFpnmA3hNKj9iwemfXHfQBnMIJHKVoBw Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 5d8fe9c1759f4b52b83110351d2a31eb Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2011293665 Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:02:53.928090 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:02:53.929874 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8fe9c1759f4b52b83110351d2a31eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8fe9c1759f4b52b83110351d2a31eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d8fe9c1759f4b52b83110351d2a31eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d8fe9c1759f4b52b83110351d2a31eb", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:53.929874 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2011293665 Sep 11 01:02:53.929874 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 5d8fe9c1759f4b52b83110351d2a31eb Sep 11 01:02:53.929874 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2011293665 Sep 11 01:02:53.929874 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-VolumesSnapshotsTestJSON-2011293665-project Sep 11 01:02:53.929874 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:02:53.929874 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:02:53.929874 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: fbbbcaddfb6a48efa43629988623cdb9 Sep 11 01:02:53.929874 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2011293665-project Sep 11 01:02:53.929874 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: Sep 11 01:02:53.929874 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:53.929874 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': '35d4aeab-e272-49ed-bcbf-46b0770651e3'} Sep 11 01:02:53.929874 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. (HTTP 404) (Request-ID: req-03a33790-9a47-4a4b-be74-425366e2dded) Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:53.931043 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 01:02:53.932319 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 01:02:53.933548 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:53.934819 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:53.934819 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:53.934819 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:53.934819 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:53.934819 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:53.934819 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:53.934819 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:53.934819 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:53.934819 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:53.934819 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:53.934819 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:53.934819 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6865dd50-a2e4-4579-a030-648171dba60f tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Returning 404 to user: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:53.934819 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6865dd50-a2e4-4579-a030-648171dba60f tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3" status: 404 len: 109 microversion: 2.1 time: 0.055261 Sep 11 01:02:53.934819 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 443/903] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Sep 11 01:02:53 2022] GET /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:02:53.943925 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-09685e38-4498-464b-9166-7ddb86fa7a6d tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Calling method '.version_select at 0x7fbb90575f70>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:53.972836 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-09685e38-4498-464b-9166-7ddb86fa7a6d tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] HTTP exception thrown: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-09685e38-4498-464b-9166-7ddb86fa7a6d tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Request method failure captured: Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: DELETE /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3 HTTP/1.1 Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTO4H7IEGXpc0MakJIAnChN0GUKoYOsomf4CnbgIVYFeEhUDmsYFv0otwsW_CZ26YTeWXQITK5isRCyP3DUexR54RNE_d1HXXQCPJoeVWK67UtRphtpa-urVjoVy9rm-WpsY6nXEGjI7gQljFpnmA3hNKj9iwemfXHfQBnMIJHKVoBw Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 5d8fe9c1759f4b52b83110351d2a31eb Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2011293665 Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:02:53.974886 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:02:53.976626 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8fe9c1759f4b52b83110351d2a31eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8fe9c1759f4b52b83110351d2a31eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d8fe9c1759f4b52b83110351d2a31eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d8fe9c1759f4b52b83110351d2a31eb", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:53.976626 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2011293665 Sep 11 01:02:53.976626 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 5d8fe9c1759f4b52b83110351d2a31eb Sep 11 01:02:53.976626 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2011293665 Sep 11 01:02:53.976626 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-VolumesSnapshotsTestJSON-2011293665-project Sep 11 01:02:53.976626 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:02:53.976626 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:02:53.976626 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: fbbbcaddfb6a48efa43629988623cdb9 Sep 11 01:02:53.976626 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2011293665-project Sep 11 01:02:53.976626 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: Sep 11 01:02:53.976626 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:53.976626 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': '35d4aeab-e272-49ed-bcbf-46b0770651e3'} Sep 11 01:02:53.976626 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. (HTTP 404) (Request-ID: req-df78ed8f-c4fe-4d49-ac35-94f43753bb79) Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:53.977839 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 01:02:53.979501 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 01:02:53.980999 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:53.982423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:53.982423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:53.982423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:53.982423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:53.982423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:53.982423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:53.982423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:53.982423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:53.982423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:53.982423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:53.982423 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:53.982423 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-09685e38-4498-464b-9166-7ddb86fa7a6d tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Returning 404 to user: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:53.982423 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-09685e38-4498-464b-9166-7ddb86fa7a6d tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3" status: 404 len: 109 microversion: 2.1 time: 0.036328 Sep 11 01:02:53.982423 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 461/904] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Sep 11 01:02:53 2022] DELETE /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:02:53.986418 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1b89ccc9-9715-4448-a993-900f0a9e97dc tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Calling method '.version_select at 0x7fbb906961f0>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:54.014804 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-1b89ccc9-9715-4448-a993-900f0a9e97dc tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] HTTP exception thrown: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1b89ccc9-9715-4448-a993-900f0a9e97dc tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Request method failure captured: Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3 HTTP/1.1 Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTO4H7IEGXpc0MakJIAnChN0GUKoYOsomf4CnbgIVYFeEhUDmsYFv0otwsW_CZ26YTeWXQITK5isRCyP3DUexR54RNE_d1HXXQCPJoeVWK67UtRphtpa-urVjoVy9rm-WpsY6nXEGjI7gQljFpnmA3hNKj9iwemfXHfQBnMIJHKVoBw Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 5d8fe9c1759f4b52b83110351d2a31eb Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2011293665 Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:02:54.016777 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:02:54.018435 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8fe9c1759f4b52b83110351d2a31eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d8fe9c1759f4b52b83110351d2a31eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d8fe9c1759f4b52b83110351d2a31eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d8fe9c1759f4b52b83110351d2a31eb", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:54.018435 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2011293665 Sep 11 01:02:54.018435 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 5d8fe9c1759f4b52b83110351d2a31eb Sep 11 01:02:54.018435 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2011293665 Sep 11 01:02:54.018435 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-VolumesSnapshotsTestJSON-2011293665-project Sep 11 01:02:54.018435 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:02:54.018435 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:02:54.018435 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: fbbbcaddfb6a48efa43629988623cdb9 Sep 11 01:02:54.018435 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2011293665-project Sep 11 01:02:54.018435 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: Sep 11 01:02:54.018435 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:54.018435 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': '35d4aeab-e272-49ed-bcbf-46b0770651e3'} Sep 11 01:02:54.018435 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. (HTTP 404) (Request-ID: req-dca53190-149c-4e99-b772-eea85619ebfa) Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:54.019422 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 01:02:54.020841 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 01:02:54.022255 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:54.023600 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:54.023600 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:54.023600 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:54.023600 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:54.023600 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:54.023600 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:54.023600 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:54.023600 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:54.023600 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:54.023600 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. Sep 11 01:02:54.023600 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:02:54.023600 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1b89ccc9-9715-4448-a993-900f0a9e97dc tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] Returning 404 to user: Volume 35d4aeab-e272-49ed-bcbf-46b0770651e3 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:54.023600 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1b89ccc9-9715-4448-a993-900f0a9e97dc tempest-VolumesSnapshotsTestJSON-2011293665 tempest-VolumesSnapshotsTestJSON-2011293665-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3" status: 404 len: 109 microversion: 2.1 time: 0.036367 Sep 11 01:02:54.023600 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 444/905] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Sep 11 01:02:53 2022] GET /compute/v2.1/os-volumes/35d4aeab-e272-49ed-bcbf-46b0770651e3 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:02:54.122024 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-caa25bcd-2c42-42ea-bb2b-5a37fabbc076 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:54.122712 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-caa25bcd-2c42-42ea-bb2b-5a37fabbc076 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] [instance: a12275e3-a215-4bde-a179-8b6a11c454ef] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:54.130346 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-caa25bcd-2c42-42ea-bb2b-5a37fabbc076 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:54.130877 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-caa25bcd-2c42-42ea-bb2b-5a37fabbc076 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:54.131345 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-caa25bcd-2c42-42ea-bb2b-5a37fabbc076 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:54.132100 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-caa25bcd-2c42-42ea-bb2b-5a37fabbc076 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:54.132557 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-caa25bcd-2c42-42ea-bb2b-5a37fabbc076 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:54.132981 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-caa25bcd-2c42-42ea-bb2b-5a37fabbc076 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:54.148346 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-caa25bcd-2c42-42ea-bb2b-5a37fabbc076 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] HTTP exception thrown: Instance a12275e3-a215-4bde-a179-8b6a11c454ef could not be found. Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-caa25bcd-2c42-42ea-bb2b-5a37fabbc076 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Request method failure captured: Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef HTTP/1.1 Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTOruqZ8ljjCbV0iAy-NQnY9StQeKGdGbOch28iXHiR4lmstPduRx1MGWu5SLqnYDudZ3SQyDC_LNia2fFK-0cr4K7uuMZNt54ezEzkQwRT9GnF8jACjZBl1zhu4yxIEiWpr-ntSGI172PdEMEFJOHrt3qtHitGe6OeJkqSizXLZXfA Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: eecf50e62b474fa1ae29cf0197bdefe7 Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-VolumesNegativeTest-398504094 Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:02:54.149993 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:02:54.151902 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eecf50e62b474fa1ae29cf0197bdefe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eecf50e62b474fa1ae29cf0197bdefe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eecf50e62b474fa1ae29cf0197bdefe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eecf50e62b474fa1ae29cf0197bdefe7", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:02:54.151902 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-VolumesNegativeTest-398504094 Sep 11 01:02:54.151902 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: eecf50e62b474fa1ae29cf0197bdefe7 Sep 11 01:02:54.151902 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-VolumesNegativeTest-398504094 Sep 11 01:02:54.151902 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-VolumesNegativeTest-398504094-project Sep 11 01:02:54.151902 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:02:54.151902 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:02:54.151902 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: 74cd83f1bed24ac48ea36b91613f021c Sep 11 01:02:54.151902 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-VolumesNegativeTest-398504094-project Sep 11 01:02:54.151902 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 01:02:54.151902 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance a12275e3-a215-4bde-a179-8b6a11c454ef could not be found. Sep 11 01:02:54.151902 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': 'a12275e3-a215-4bde-a179-8b6a11c454ef'} Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12275e3-a215-4bde-a179-8b6a11c454ef could not be found. Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:02:54.152923 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12275e3-a215-4bde-a179-8b6a11c454ef could not be found. Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12275e3-a215-4bde-a179-8b6a11c454ef could not be found. Sep 11 01:02:54.154490 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:02:54.156911 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-caa25bcd-2c42-42ea-bb2b-5a37fabbc076 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] Returning 404 to user: Instance a12275e3-a215-4bde-a179-8b6a11c454ef could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:02:54.156911 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-caa25bcd-2c42-42ea-bb2b-5a37fabbc076 tempest-VolumesNegativeTest-398504094 tempest-VolumesNegativeTest-398504094-project] 10.222.0.23 "GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef" status: 404 len: 111 microversion: 2.1 time: 0.033433 Sep 11 01:02:54.156911 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 462/906] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:02:54 2022] GET /compute/v2.1/servers/a12275e3-a215-4bde-a179-8b6a11c454ef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:02:56.208976 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-af51bb7f-0a9b-41de-a6e0-095a4bcbe0ce tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-492462541"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:02:56.209688 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-af51bb7f-0a9b-41de-a6e0-095a4bcbe0ce tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:56.217478 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-af51bb7f-0a9b-41de-a6e0-095a4bcbe0ce tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:56.217970 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-af51bb7f-0a9b-41de-a6e0-095a4bcbe0ce tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:56.218412 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-af51bb7f-0a9b-41de-a6e0-095a4bcbe0ce tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:56.219477 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-af51bb7f-0a9b-41de-a6e0-095a4bcbe0ce tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:56.219928 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-af51bb7f-0a9b-41de-a6e0-095a4bcbe0ce tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:56.220523 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-af51bb7f-0a9b-41de-a6e0-095a4bcbe0ce tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:56.375588 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.network.security_group_api [None req-af51bb7f-0a9b-41de-a6e0-095a4bcbe0ce tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Removing security group ce2a4222-7b25-4dd8-ae38-3301340317e5 from port b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71 Sep 11 01:02:56.776789 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-af51bb7f-0a9b-41de-a6e0-095a4bcbe0ce tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "POST /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/action" status: 202 len: 0 microversion: 2.1 time: 0.574962 Sep 11 01:02:56.777646 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 445/907] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Sep 11 01:02:56 2022] POST /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:02:56.792970 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-92312b7d-e171-4ec1-bddd-76858829359f req-e9fcfd67-8212-4189-b866-95e32c119e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65943bbe-32ae-424f-8341-ddf47713744f", "tag": "b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:02:56.820665 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-92312b7d-e171-4ec1-bddd-76858829359f req-e9fcfd67-8212-4189-b866-95e32c119e88 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:56.821144 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-92312b7d-e171-4ec1-bddd-76858829359f req-e9fcfd67-8212-4189-b866-95e32c119e88 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:56.821573 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-92312b7d-e171-4ec1-bddd-76858829359f req-e9fcfd67-8212-4189-b866-95e32c119e88 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:56.853572 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-92312b7d-e171-4ec1-bddd-76858829359f req-e9fcfd67-8212-4189-b866-95e32c119e88 service nova] Creating event network-changed:b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71 for instance 65943bbe-32ae-424f-8341-ddf47713744f on hv-cinder-maste Sep 11 01:02:56.870125 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-92312b7d-e171-4ec1-bddd-76858829359f req-e9fcfd67-8212-4189-b866-95e32c119e88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083734 Sep 11 01:02:56.873247 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 463/908] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:02:58.617112 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-adbae7b0-2fdd-4a9e-bf90-f08d0a0e379f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:58.617788 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-adbae7b0-2fdd-4a9e-bf90-f08d0a0e379f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:58.624393 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-adbae7b0-2fdd-4a9e-bf90-f08d0a0e379f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:58.624876 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-adbae7b0-2fdd-4a9e-bf90-f08d0a0e379f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:58.625433 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-adbae7b0-2fdd-4a9e-bf90-f08d0a0e379f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:58.626139 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-adbae7b0-2fdd-4a9e-bf90-f08d0a0e379f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:58.626612 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-adbae7b0-2fdd-4a9e-bf90-f08d0a0e379f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:58.627033 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-adbae7b0-2fdd-4a9e-bf90-f08d0a0e379f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:58.715130 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-adbae7b0-2fdd-4a9e-bf90-f08d0a0e379f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lazy-loading 'services' on Instance uuid 65943bbe-32ae-424f-8341-ddf47713744f {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:02:58.795821 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-adbae7b0-2fdd-4a9e-bf90-f08d0a0e379f tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "DELETE /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/os-volume_attachments/ca2efa77-4eb8-4696-a4d9-9b9b39436891" status: 202 len: 0 microversion: 2.1 time: 0.182893 Sep 11 01:02:58.796400 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 446/909] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Sep 11 01:02:58 2022] DELETE /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/os-volume_attachments/ca2efa77-4eb8-4696-a4d9-9b9b39436891 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:02:58.806923 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-36c185ce-2f83-424a-bb21-d09916a975ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:58.810447 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-36c185ce-2f83-424a-bb21-d09916a975ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:58.820418 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36c185ce-2f83-424a-bb21-d09916a975ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:58.821097 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36c185ce-2f83-424a-bb21-d09916a975ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:58.821532 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36c185ce-2f83-424a-bb21-d09916a975ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:58.823215 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36c185ce-2f83-424a-bb21-d09916a975ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:58.823851 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36c185ce-2f83-424a-bb21-d09916a975ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:58.824458 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-36c185ce-2f83-424a-bb21-d09916a975ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:58.875063 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-36c185ce-2f83-424a-bb21-d09916a975ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073467 Sep 11 01:02:58.882617 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 464/910] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:02:58 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:02:58.894241 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-e5a0b925-c2d7-44f9-89b9-efb76d12f3d0 req-1225719c-40fc-464b-8d35-4cfba4b3f0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65943bbe-32ae-424f-8341-ddf47713744f", "tag": "b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:02:58.904228 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-e5a0b925-c2d7-44f9-89b9-efb76d12f3d0 req-1225719c-40fc-464b-8d35-4cfba4b3f0c7 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:58.904712 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-e5a0b925-c2d7-44f9-89b9-efb76d12f3d0 req-1225719c-40fc-464b-8d35-4cfba4b3f0c7 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:58.905136 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-e5a0b925-c2d7-44f9-89b9-efb76d12f3d0 req-1225719c-40fc-464b-8d35-4cfba4b3f0c7 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:58.917615 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-e5a0b925-c2d7-44f9-89b9-efb76d12f3d0 req-1225719c-40fc-464b-8d35-4cfba4b3f0c7 service nova] Creating event network-changed:b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71 for instance 65943bbe-32ae-424f-8341-ddf47713744f on hv-cinder-maste Sep 11 01:02:58.922675 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-e5a0b925-c2d7-44f9-89b9-efb76d12f3d0 req-1225719c-40fc-464b-8d35-4cfba4b3f0c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032699 Sep 11 01:02:58.923555 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 447/911] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:02:59.889584 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-66754246-79c3-4564-8283-422482173927 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:59.891902 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-66754246-79c3-4564-8283-422482173927 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:59.898269 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-66754246-79c3-4564-8283-422482173927 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:59.899071 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-66754246-79c3-4564-8283-422482173927 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:59.899195 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-66754246-79c3-4564-8283-422482173927 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:59.899894 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-66754246-79c3-4564-8283-422482173927 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:59.900487 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-66754246-79c3-4564-8283-422482173927 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:59.900908 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-66754246-79c3-4564-8283-422482173927 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:59.927382 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:59.931711 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-66754246-79c3-4564-8283-422482173927 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046217 Sep 11 01:02:59.932717 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 465/912] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Sep 11 01:02:59 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 01:02:59.943746 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c8005d31-b517-47db-a422-a7c745d92d56 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:02:59.944361 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c8005d31-b517-47db-a422-a7c745d92d56 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:02:59.952085 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8005d31-b517-47db-a422-a7c745d92d56 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:59.952684 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8005d31-b517-47db-a422-a7c745d92d56 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:59.953234 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8005d31-b517-47db-a422-a7c745d92d56 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:02:59.954023 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8005d31-b517-47db-a422-a7c745d92d56 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:02:59.954572 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8005d31-b517-47db-a422-a7c745d92d56 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:02:59.955060 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8005d31-b517-47db-a422-a7c745d92d56 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:03:00.048291 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-c8005d31-b517-47db-a422-a7c745d92d56 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] HTTP exception thrown: Instance 65943bbe-32ae-424f-8341-ddf47713744f is not attached to volume ca2efa77-4eb8-4696-a4d9-9b9b39436891 Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c8005d31-b517-47db-a422-a7c745d92d56 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Request method failure captured: Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: DELETE /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/os-volume_attachments/ca2efa77-4eb8-4696-a4d9-9b9b39436891 HTTP/1.1 Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTM--e5T61Vdxzyv2FWbSdNCW0y5BKgamP_Iaohh4DHuPx6E_xU8_6FtQAXN3DN8utBS6gccvsutbYOYqhaj8e3_Qt2RoA-EB477rt16L4uMsoFvbkASbIeHBpUkHKlb4yFlm2r1e22mlD5kKZe4eKLpD4kt8t8q4t7ASa0tntIeKN0 Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: 69a25da8ed8849bba71977e48ec7bd8d Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-TestMinimumBasicScenario-1235828323 Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:03:00.054757 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:03:00.056272 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/69a25da8ed8849bba71977e48ec7bd8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/69a25da8ed8849bba71977e48ec7bd8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/69a25da8ed8849bba71977e48ec7bd8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_69a25da8ed8849bba71977e48ec7bd8d", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:03:00.056272 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-TestMinimumBasicScenario-1235828323 Sep 11 01:03:00.056272 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: 69a25da8ed8849bba71977e48ec7bd8d Sep 11 01:03:00.056272 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1235828323 Sep 11 01:03:00.056272 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-TestMinimumBasicScenario-1235828323-project Sep 11 01:03:00.056272 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:03:00.056272 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:03:00.056272 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: b0ba6f92b3d34bbeb1f7d52de32cd29c Sep 11 01:03:00.056272 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-TestMinimumBasicScenario-1235828323-project Sep 11 01:03:00.056272 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:03:00.056272 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance 65943bbe-32ae-424f-8341-ddf47713744f is not attached to volume ca2efa77-4eb8-4696-a4d9-9b9b39436891 Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'server_id': '65943bbe-32ae-424f-8341-ddf47713744f', 'id': 'ca2efa77-4eb8-4696-a4d9-9b9b39436891'} Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ca2efa77-4eb8-4696-a4d9-9b9b39436891. Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:03:00.057021 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:03:00.058209 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:03:00.058209 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 11 01:03:00.058209 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 11 01:03:00.058209 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65943bbe-32ae-424f-8341-ddf47713744f is not attached to volume ca2efa77-4eb8-4696-a4d9-9b9b39436891 Sep 11 01:03:00.058209 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:03:00.058209 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:03:00.058209 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:03:00.058209 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:03:00.058209 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:03:00.058209 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:03:00.058209 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:03:00.058209 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:03:00.058209 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65943bbe-32ae-424f-8341-ddf47713744f is not attached to volume ca2efa77-4eb8-4696-a4d9-9b9b39436891 Sep 11 01:03:00.058209 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:03:00.059998 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c8005d31-b517-47db-a422-a7c745d92d56 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Returning 404 to user: Instance 65943bbe-32ae-424f-8341-ddf47713744f is not attached to volume ca2efa77-4eb8-4696-a4d9-9b9b39436891 {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:03:00.061087 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c8005d31-b517-47db-a422-a7c745d92d56 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "DELETE /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/os-volume_attachments/ca2efa77-4eb8-4696-a4d9-9b9b39436891" status: 404 len: 154 microversion: 2.1 time: 0.122034 Sep 11 01:03:00.067639 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 448/913] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Sep 11 01:02:59 2022] DELETE /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f/os-volume_attachments/ca2efa77-4eb8-4696-a4d9-9b9b39436891 => generated 154 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:03:01.225347 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a6f91e58-1feb-4a1d-9058-034a8c2e86ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:03:01.225803 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a6f91e58-1feb-4a1d-9058-034a8c2e86ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:03:01.234282 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a6f91e58-1feb-4a1d-9058-034a8c2e86ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:03:01.234799 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a6f91e58-1feb-4a1d-9058-034a8c2e86ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:03:01.235264 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a6f91e58-1feb-4a1d-9058-034a8c2e86ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:03:01.235966 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a6f91e58-1feb-4a1d-9058-034a8c2e86ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:03:01.236528 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a6f91e58-1feb-4a1d-9058-034a8c2e86ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:03:01.236951 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-a6f91e58-1feb-4a1d-9058-034a8c2e86ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:03:01.262990 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a6f91e58-1feb-4a1d-9058-034a8c2e86ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Going to try to terminate instance {{(pid=120497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 01:03:01.341409 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a6f91e58-1feb-4a1d-9058-034a8c2e86ee tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "DELETE /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 204 len: 0 microversion: 2.1 time: 0.119961 Sep 11 01:03:01.342018 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 466/914] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:03:01 2022] DELETE /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 01:03:01.350799 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-508af6fb-5134-4a4c-9bed-c443156e4ef3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:03:01.351514 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-508af6fb-5134-4a4c-9bed-c443156e4ef3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:03:01.358287 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-508af6fb-5134-4a4c-9bed-c443156e4ef3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:03:01.358761 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-508af6fb-5134-4a4c-9bed-c443156e4ef3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:03:01.359228 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-508af6fb-5134-4a4c-9bed-c443156e4ef3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:03:01.359943 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-508af6fb-5134-4a4c-9bed-c443156e4ef3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:03:01.360465 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-508af6fb-5134-4a4c-9bed-c443156e4ef3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:03:01.360894 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-508af6fb-5134-4a4c-9bed-c443156e4ef3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:03:01.497050 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-508af6fb-5134-4a4c-9bed-c443156e4ef3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:03:01.500641 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:01.505421 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-508af6fb-5134-4a4c-9bed-c443156e4ef3 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1554 microversion: 2.1 time: 0.158726 Sep 11 01:03:01.506002 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 449/915] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:03:01 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:03:02.528383 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d14c9c30-973d-4b16-8aa1-775aced4eb61 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:03:02.529184 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d14c9c30-973d-4b16-8aa1-775aced4eb61 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:03:02.536624 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d14c9c30-973d-4b16-8aa1-775aced4eb61 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:03:02.537149 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d14c9c30-973d-4b16-8aa1-775aced4eb61 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:03:02.537579 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d14c9c30-973d-4b16-8aa1-775aced4eb61 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:03:02.538266 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d14c9c30-973d-4b16-8aa1-775aced4eb61 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:03:02.538880 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d14c9c30-973d-4b16-8aa1-775aced4eb61 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:03:02.539321 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d14c9c30-973d-4b16-8aa1-775aced4eb61 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:03:02.681448 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d14c9c30-973d-4b16-8aa1-775aced4eb61 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:03:02.689767 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d14c9c30-973d-4b16-8aa1-775aced4eb61 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1554 microversion: 2.1 time: 0.165665 Sep 11 01:03:02.690776 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 467/916] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:03:02 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:03:03.714278 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-727795ea-51c4-4fd4-bf65-24d485087964 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:03:03.714897 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-727795ea-51c4-4fd4-bf65-24d485087964 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:03:03.722046 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-727795ea-51c4-4fd4-bf65-24d485087964 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:03:03.722046 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-727795ea-51c4-4fd4-bf65-24d485087964 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:03:03.722501 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-727795ea-51c4-4fd4-bf65-24d485087964 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:03:03.723344 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-727795ea-51c4-4fd4-bf65-24d485087964 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:03:03.723985 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-727795ea-51c4-4fd4-bf65-24d485087964 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:03:03.724435 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-727795ea-51c4-4fd4-bf65-24d485087964 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:03:03.734989 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-8b7a9d04-32cc-42f1-95a0-bdd1b6893e07 req-23bac6fd-5169-494a-afce-2f757c298a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65943bbe-32ae-424f-8341-ddf47713744f", "name": "network-vif-deleted", "tag": "b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:03:03.748119 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-8b7a9d04-32cc-42f1-95a0-bdd1b6893e07 req-23bac6fd-5169-494a-afce-2f757c298a08 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:03:03.748852 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-8b7a9d04-32cc-42f1-95a0-bdd1b6893e07 req-23bac6fd-5169-494a-afce-2f757c298a08 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:03:03.749268 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-8b7a9d04-32cc-42f1-95a0-bdd1b6893e07 req-23bac6fd-5169-494a-afce-2f757c298a08 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:03:03.766330 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-8b7a9d04-32cc-42f1-95a0-bdd1b6893e07 req-23bac6fd-5169-494a-afce-2f757c298a08 service nova] Creating event network-vif-deleted:b8ef7ddc-dcdf-49c9-9323-f68dcd8c3a71 for instance 65943bbe-32ae-424f-8341-ddf47713744f on hv-cinder-maste Sep 11 01:03:03.773400 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-8b7a9d04-32cc-42f1-95a0-bdd1b6893e07 req-23bac6fd-5169-494a-afce-2f757c298a08 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042825 Sep 11 01:03:03.774641 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 468/917] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:03:03.794847 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-727795ea-51c4-4fd4-bf65-24d485087964 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba6f92b3d34bbeb1f7d52de32cd29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a25da8ed8849bba71977e48ec7bd8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:03:03.804621 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-727795ea-51c4-4fd4-bf65-24d485087964 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 200 len: 1512 microversion: 2.1 time: 0.094528 Sep 11 01:03:03.819597 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 450/918] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:03:03 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 1512 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:03:04.830442 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0ebdd58b-f323-4025-9d75-23b5bed9ccdb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:03:04.831136 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-0ebdd58b-f323-4025-9d75-23b5bed9ccdb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] [instance: 65943bbe-32ae-424f-8341-ddf47713744f] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:03:04.837470 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0ebdd58b-f323-4025-9d75-23b5bed9ccdb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:03:04.837957 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0ebdd58b-f323-4025-9d75-23b5bed9ccdb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:03:04.838385 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0ebdd58b-f323-4025-9d75-23b5bed9ccdb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:03:04.839071 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0ebdd58b-f323-4025-9d75-23b5bed9ccdb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:03:04.839732 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0ebdd58b-f323-4025-9d75-23b5bed9ccdb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:03:04.840154 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0ebdd58b-f323-4025-9d75-23b5bed9ccdb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:03:04.855061 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.wsgi [None req-0ebdd58b-f323-4025-9d75-23b5bed9ccdb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] HTTP exception thrown: Instance 65943bbe-32ae-424f-8341-ddf47713744f could not be found. Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0ebdd58b-f323-4025-9d75-23b5bed9ccdb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Request method failure captured: Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: request: GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f HTTP/1.1 Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept: application/json Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: Accept-Encoding: identity Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: Connection: close Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Length: 0 Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: Content-Type: application/json Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: Host: 10.222.0.23 Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: Openstack-System-Scope: None Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: User-Agent: python-urllib3/1.26.12 Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Auth-Token: gAAAAABjHTM--e5T61Vdxzyv2FWbSdNCW0y5BKgamP_Iaohh4DHuPx6E_xU8_6FtQAXN3DN8utBS6gccvsutbYOYqhaj8e3_Qt2RoA-EB477rt16L4uMsoFvbkASbIeHBpUkHKlb4yFlm2r1e22mlD5kKZe4eKLpD4kt8t8q4t7ASa0tntIeKN0 Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Id: None Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Domain-Name: None Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Identity-Status: Confirmed Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Is-Admin-Project: True Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Id: default Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Domain-Name: Default Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Id: 69a25da8ed8849bba71977e48ec7bd8d Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Project-Name: tempest-TestMinimumBasicScenario-1235828323 Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Role: member,reader Sep 11 01:03:04.856811 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Roles: member,reader Sep 11 01:03:04.858318 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/69a25da8ed8849bba71977e48ec7bd8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/69a25da8ed8849bba71977e48ec7bd8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/69a25da8ed8849bba71977e48ec7bd8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_69a25da8ed8849bba71977e48ec7bd8d", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:03:04.858318 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant: tempest-TestMinimumBasicScenario-1235828323 Sep 11 01:03:04.858318 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Id: 69a25da8ed8849bba71977e48ec7bd8d Sep 11 01:03:04.858318 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1235828323 Sep 11 01:03:04.858318 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User: tempest-TestMinimumBasicScenario-1235828323-project Sep 11 01:03:04.858318 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Id: default Sep 11 01:03:04.858318 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Domain-Name: Default Sep 11 01:03:04.858318 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Id: b0ba6f92b3d34bbeb1f7d52de32cd29c Sep 11 01:03:04.858318 dv-cinder-master-3-smb devstack@n-api.service[120497]: X-User-Name: tempest-TestMinimumBasicScenario-1235828323-project Sep 11 01:03:04.858318 dv-cinder-master-3-smb devstack@n-api.service[120497]: method: > Sep 11 01:03:04.858318 dv-cinder-master-3-smb devstack@n-api.service[120497]: exception: Instance 65943bbe-32ae-424f-8341-ddf47713744f could not be found. Sep 11 01:03:04.858318 dv-cinder-master-3-smb devstack@n-api.service[120497]: action_args: {'id': '65943bbe-32ae-424f-8341-ddf47713744f'} Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65943bbe-32ae-424f-8341-ddf47713744f could not be found. Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:03:04.859589 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65943bbe-32ae-424f-8341-ddf47713744f could not be found. Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65943bbe-32ae-424f-8341-ddf47713744f could not be found. Sep 11 01:03:04.861724 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR nova.api.openstack.wsgi Sep 11 01:03:04.863557 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0ebdd58b-f323-4025-9d75-23b5bed9ccdb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Returning 404 to user: Instance 65943bbe-32ae-424f-8341-ddf47713744f could not be found. {{(pid=120497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:03:04.863557 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0ebdd58b-f323-4025-9d75-23b5bed9ccdb tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f" status: 404 len: 111 microversion: 2.1 time: 0.032888 Sep 11 01:03:04.863557 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 469/919] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:03:04 2022] GET /compute/v2.1/servers/65943bbe-32ae-424f-8341-ddf47713744f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:03:04.868085 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f4a3fd62-e2b0-43a3-b671-e668b26243b4 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] Calling method '.version_select at 0x7fbb905f03a0>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:03:04.889333 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f4a3fd62-e2b0-43a3-b671-e668b26243b4 tempest-TestMinimumBasicScenario-1235828323 tempest-TestMinimumBasicScenario-1235828323-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-534682617" status: 202 len: 0 microversion: 2.1 time: 0.025256 Sep 11 01:03:04.889921 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 451/920] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Sep 11 01:03:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-534682617 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 01:03:43.693228 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:43.693982 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:43.926282 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-08deb44a-44ef-46d3-9495-d80b5c82d53a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Action: 'create', calling method: .version_select at 0x7fbb905c6700>, body: {"keypair": {"name": "tempest-TestShelveInstance-862224524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyTtgXghxIirTc+uezxRsJB3VWOqSjpEXmu26UltWHyjQDNuVbO/gb9R0vixP5JI9/9vtHlf1RTKyCwQdHtvlG1EA86FfKiw3wIm6Ec1xUCPajOoJtEJlb6segHLxOYdw=="}} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:03:43.942339 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-08deb44a-44ef-46d3-9495-d80b5c82d53a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Getting quotas for project e7b47e4ca8c0414790b8d0fa30559d25. Resources: {'key_pairs'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 01:03:43.946445 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.quota [None req-08deb44a-44ef-46d3-9495-d80b5c82d53a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Getting quotas for user c97d41a8f1ff40e79472aa4bf9790ae5 and project e7b47e4ca8c0414790b8d0fa30559d25. Resources: {'key_pairs'} {{(pid=120497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 01:03:43.970764 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-08deb44a-44ef-46d3-9495-d80b5c82d53a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.303558 Sep 11 01:03:43.971729 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 470/921] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Sep 11 01:03:43 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:03:57.386488 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=6 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:57.387233 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:57.391813 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1515170811", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-862224524", "security_groups": [{"name": "tempest-secgroup-smoke-941384908"}], "networks": [{"uuid": "eeee4816-c346-45f4-8ab8-44615a381022"}], "block_device_mapping_v2": [{"uuid": "35f4650b-8df2-4b33-a9fb-5b89f5ab5128", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:03:57.517249 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] validate_networks() for [('eeee4816-c346-45f4-8ab8-44615a381022', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 01:03:57.900621 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 01:03:57.901127 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 01:03:57.901600 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 01:03:57.902006 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 01:03:57.902413 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 01:03:57.912858 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:03:57.913345 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:03:57.913776 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:03:57.914539 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:03:57.914985 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:03:57.915449 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:03:57.934049 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Getting quotas for project e7b47e4ca8c0414790b8d0fa30559d25. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 01:03:57.938249 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.quota [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Getting quotas for user c97d41a8f1ff40e79472aa4bf9790ae5 and project e7b47e4ca8c0414790b8d0fa30559d25. Resources: {'instances', 'ram', 'cores'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 01:03:57.998328 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 01:03:58.000489 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35f4650b-8df2-4b33-a9fb-5b89f5ab5128',volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 01:03:58.131961 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [87ae6367-379b-4e4f-8e8d-cdea12d96d95] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 11 01:03:59.142073 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO oslo.messaging._drivers.impl_rabbit [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [87ae6367-379b-4e4f-8e8d-cdea12d96d95] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 53210. Sep 11 01:03:59.147544 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6188b69f-0427-45a7-8ec1-5dfbec15e3d6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.762551 Sep 11 01:03:59.148271 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 452/922] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Sep 11 01:03:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 01:03:59.158041 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=4 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:59.159410 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:59.164710 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-a88c9c91-e285-4766-bd05-960efe6d2014 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:03:59.165383 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-a88c9c91-e285-4766-bd05-960efe6d2014 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:03:59.222002 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-a88c9c91-e285-4766-bd05-960efe6d2014 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:03:59.230479 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-a88c9c91-e285-4766-bd05-960efe6d2014 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1088 microversion: 2.1 time: 0.074022 Sep 11 01:03:59.231538 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 471/923] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:03:59 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:04:00.255990 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5fb8b1ab-ef1d-4efd-8516-0a9828b59079 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:04:00.256581 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5fb8b1ab-ef1d-4efd-8516-0a9828b59079 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:04:00.263925 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5fb8b1ab-ef1d-4efd-8516-0a9828b59079 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:00.264659 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5fb8b1ab-ef1d-4efd-8516-0a9828b59079 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:00.265149 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5fb8b1ab-ef1d-4efd-8516-0a9828b59079 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:00.266220 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5fb8b1ab-ef1d-4efd-8516-0a9828b59079 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:00.266878 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5fb8b1ab-ef1d-4efd-8516-0a9828b59079 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:00.267555 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5fb8b1ab-ef1d-4efd-8516-0a9828b59079 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:00.343507 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-5fb8b1ab-ef1d-4efd-8516-0a9828b59079 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:04:00.351966 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5fb8b1ab-ef1d-4efd-8516-0a9828b59079 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1186 microversion: 2.1 time: 0.100603 Sep 11 01:04:00.352546 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 453/924] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:04:00 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1186 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:04:01.375528 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-8ab5909b-bc36-4c03-8db3-ed67147a5a1e tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:04:01.376259 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-8ab5909b-bc36-4c03-8db3-ed67147a5a1e tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:04:01.383526 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8ab5909b-bc36-4c03-8db3-ed67147a5a1e tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:01.384103 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8ab5909b-bc36-4c03-8db3-ed67147a5a1e tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:01.384539 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8ab5909b-bc36-4c03-8db3-ed67147a5a1e tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:01.385243 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8ab5909b-bc36-4c03-8db3-ed67147a5a1e tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:01.385686 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8ab5909b-bc36-4c03-8db3-ed67147a5a1e tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:01.386106 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-8ab5909b-bc36-4c03-8db3-ed67147a5a1e tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:01.579538 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-8ab5909b-bc36-4c03-8db3-ed67147a5a1e tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:04:01.587805 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-8ab5909b-bc36-4c03-8db3-ed67147a5a1e tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1259 microversion: 2.1 time: 0.216231 Sep 11 01:04:01.588378 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 472/925] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:04:01 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:04:01.879206 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-c0638d92-6e68-4453-8c72-bc7b8faaebbc req-f1f93adf-8368-45a4-a053-664605e89275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80717588-ea72-4197-9e6d-c0661eadb3d0", "tag": "baba8f61-84fd-4633-a26f-d02e2b3b7e4a"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:04:01.890369 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c0638d92-6e68-4453-8c72-bc7b8faaebbc req-f1f93adf-8368-45a4-a053-664605e89275 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:01.890899 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c0638d92-6e68-4453-8c72-bc7b8faaebbc req-f1f93adf-8368-45a4-a053-664605e89275 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:01.891619 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c0638d92-6e68-4453-8c72-bc7b8faaebbc req-f1f93adf-8368-45a4-a053-664605e89275 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:01.903221 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-c0638d92-6e68-4453-8c72-bc7b8faaebbc req-f1f93adf-8368-45a4-a053-664605e89275 service nova] Creating event network-changed:baba8f61-84fd-4633-a26f-d02e2b3b7e4a for instance 80717588-ea72-4197-9e6d-c0661eadb3d0 on hv-cinder-maste Sep 11 01:04:01.908113 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-c0638d92-6e68-4453-8c72-bc7b8faaebbc req-f1f93adf-8368-45a4-a053-664605e89275 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034460 Sep 11 01:04:01.908703 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 454/926] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:04:02.617503 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d97ecfc0-4222-4580-a6e8-b94fc7403c2c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:04:02.618468 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d97ecfc0-4222-4580-a6e8-b94fc7403c2c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:04:02.628221 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d97ecfc0-4222-4580-a6e8-b94fc7403c2c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:02.628704 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d97ecfc0-4222-4580-a6e8-b94fc7403c2c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:02.629138 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d97ecfc0-4222-4580-a6e8-b94fc7403c2c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:02.629839 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d97ecfc0-4222-4580-a6e8-b94fc7403c2c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:02.630286 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d97ecfc0-4222-4580-a6e8-b94fc7403c2c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:02.630707 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d97ecfc0-4222-4580-a6e8-b94fc7403c2c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:02.766457 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d97ecfc0-4222-4580-a6e8-b94fc7403c2c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:04:02.774671 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d97ecfc0-4222-4580-a6e8-b94fc7403c2c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1259 microversion: 2.1 time: 0.163854 Sep 11 01:04:02.775338 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 473/927] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:04:02 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:04:03.800406 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4d9eeaea-92fe-4eac-8bc3-4e01776b50ff tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:04:03.801022 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4d9eeaea-92fe-4eac-8bc3-4e01776b50ff tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:04:03.808164 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d9eeaea-92fe-4eac-8bc3-4e01776b50ff tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:03.808646 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d9eeaea-92fe-4eac-8bc3-4e01776b50ff tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:03.809081 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d9eeaea-92fe-4eac-8bc3-4e01776b50ff tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:03.809789 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d9eeaea-92fe-4eac-8bc3-4e01776b50ff tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:03.810225 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d9eeaea-92fe-4eac-8bc3-4e01776b50ff tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:03.810646 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d9eeaea-92fe-4eac-8bc3-4e01776b50ff tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:03.973189 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-4d9eeaea-92fe-4eac-8bc3-4e01776b50ff tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:04:03.985716 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4d9eeaea-92fe-4eac-8bc3-4e01776b50ff tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1259 microversion: 2.1 time: 0.190450 Sep 11 01:04:03.986648 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 455/928] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:04:03 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:04:05.012999 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-0e2f8284-e9e2-4354-a0cc-ef85bd5847f0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:04:05.014056 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-0e2f8284-e9e2-4354-a0cc-ef85bd5847f0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:04:05.021766 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e2f8284-e9e2-4354-a0cc-ef85bd5847f0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:05.022252 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e2f8284-e9e2-4354-a0cc-ef85bd5847f0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:05.022657 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e2f8284-e9e2-4354-a0cc-ef85bd5847f0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:05.023387 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e2f8284-e9e2-4354-a0cc-ef85bd5847f0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:05.023828 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e2f8284-e9e2-4354-a0cc-ef85bd5847f0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:05.024245 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-0e2f8284-e9e2-4354-a0cc-ef85bd5847f0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:05.162855 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-0e2f8284-e9e2-4354-a0cc-ef85bd5847f0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:04:05.171221 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-0e2f8284-e9e2-4354-a0cc-ef85bd5847f0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1259 microversion: 2.1 time: 0.164917 Sep 11 01:04:05.171793 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 474/929] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:04:05 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:04:06.194429 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-db3cf47a-8c3c-48cf-9905-d40852d620a0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:04:06.195035 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-db3cf47a-8c3c-48cf-9905-d40852d620a0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:04:06.201981 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-db3cf47a-8c3c-48cf-9905-d40852d620a0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:06.202463 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-db3cf47a-8c3c-48cf-9905-d40852d620a0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:06.202890 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-db3cf47a-8c3c-48cf-9905-d40852d620a0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:06.203636 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-db3cf47a-8c3c-48cf-9905-d40852d620a0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:06.204282 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-db3cf47a-8c3c-48cf-9905-d40852d620a0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:06.204707 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-db3cf47a-8c3c-48cf-9905-d40852d620a0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:06.339746 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-db3cf47a-8c3c-48cf-9905-d40852d620a0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:04:06.347770 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-db3cf47a-8c3c-48cf-9905-d40852d620a0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1259 microversion: 2.1 time: 0.157268 Sep 11 01:04:06.348352 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 456/930] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:04:06 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:04:07.374918 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3e66245a-b87b-4858-82f0-a21c673ef6ca tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:04:07.375914 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3e66245a-b87b-4858-82f0-a21c673ef6ca tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:04:07.386932 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e66245a-b87b-4858-82f0-a21c673ef6ca tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:07.387784 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e66245a-b87b-4858-82f0-a21c673ef6ca tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:07.388504 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e66245a-b87b-4858-82f0-a21c673ef6ca tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:07.389607 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e66245a-b87b-4858-82f0-a21c673ef6ca tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:07.390373 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e66245a-b87b-4858-82f0-a21c673ef6ca tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:07.391066 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3e66245a-b87b-4858-82f0-a21c673ef6ca tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:07.528713 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3e66245a-b87b-4858-82f0-a21c673ef6ca tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:04:07.537416 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3e66245a-b87b-4858-82f0-a21c673ef6ca tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1259 microversion: 2.1 time: 0.168967 Sep 11 01:04:07.537975 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 475/931] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:04:07 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:04:08.556283 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-d9c38943-3b2d-4f17-8690-950b3c863fe6 req-32df569e-582e-4940-b0a9-af326076f3bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80717588-ea72-4197-9e6d-c0661eadb3d0", "name": "network-vif-plugged", "status": "completed", "tag": "baba8f61-84fd-4633-a26f-d02e2b3b7e4a"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:04:08.560469 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-71aa1ac2-3902-4df4-bac7-722247bf5770 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:04:08.561527 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-71aa1ac2-3902-4df4-bac7-722247bf5770 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:04:08.563022 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:08.564243 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=6 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:08.570565 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-71aa1ac2-3902-4df4-bac7-722247bf5770 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:08.571357 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-71aa1ac2-3902-4df4-bac7-722247bf5770 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:08.571794 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-71aa1ac2-3902-4df4-bac7-722247bf5770 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:08.571919 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d9c38943-3b2d-4f17-8690-950b3c863fe6 req-32df569e-582e-4940-b0a9-af326076f3bb service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:08.572323 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d9c38943-3b2d-4f17-8690-950b3c863fe6 req-32df569e-582e-4940-b0a9-af326076f3bb service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:08.572489 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-71aa1ac2-3902-4df4-bac7-722247bf5770 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:08.572753 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d9c38943-3b2d-4f17-8690-950b3c863fe6 req-32df569e-582e-4940-b0a9-af326076f3bb service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:08.573121 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-71aa1ac2-3902-4df4-bac7-722247bf5770 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:08.573543 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-71aa1ac2-3902-4df4-bac7-722247bf5770 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:08.584210 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-d9c38943-3b2d-4f17-8690-950b3c863fe6 req-32df569e-582e-4940-b0a9-af326076f3bb service nova] Creating event network-vif-plugged:baba8f61-84fd-4633-a26f-d02e2b3b7e4a for instance 80717588-ea72-4197-9e6d-c0661eadb3d0 on hv-cinder-maste Sep 11 01:04:08.589284 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-d9c38943-3b2d-4f17-8690-950b3c863fe6 req-32df569e-582e-4940-b0a9-af326076f3bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037054 Sep 11 01:04:08.590230 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 457/932] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:04:08.711667 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-71aa1ac2-3902-4df4-bac7-722247bf5770 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:04:08.719458 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-71aa1ac2-3902-4df4-bac7-722247bf5770 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1259 microversion: 2.1 time: 0.163469 Sep 11 01:04:08.720027 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 476/933] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:04:08 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:04:09.745460 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a2f98140-40a9-4c5a-a61f-7267cde10bf1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:04:09.746287 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a2f98140-40a9-4c5a-a61f-7267cde10bf1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:04:09.754108 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a2f98140-40a9-4c5a-a61f-7267cde10bf1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:09.754598 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a2f98140-40a9-4c5a-a61f-7267cde10bf1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:09.755036 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a2f98140-40a9-4c5a-a61f-7267cde10bf1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:09.755848 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a2f98140-40a9-4c5a-a61f-7267cde10bf1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:09.756310 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a2f98140-40a9-4c5a-a61f-7267cde10bf1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:09.756739 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a2f98140-40a9-4c5a-a61f-7267cde10bf1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:09.896140 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a2f98140-40a9-4c5a-a61f-7267cde10bf1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:04:09.907992 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a2f98140-40a9-4c5a-a61f-7267cde10bf1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1259 microversion: 2.1 time: 0.167840 Sep 11 01:04:09.908887 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 458/934] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:04:09 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:04:10.938484 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-837a1707-2966-41e3-8a54-6c68cdb24bf0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:04:10.939134 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-837a1707-2966-41e3-8a54-6c68cdb24bf0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:04:10.941050 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell0:SELECT=2 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:10.947851 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-837a1707-2966-41e3-8a54-6c68cdb24bf0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:10.948351 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-837a1707-2966-41e3-8a54-6c68cdb24bf0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:10.948766 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-837a1707-2966-41e3-8a54-6c68cdb24bf0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:10.949515 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-837a1707-2966-41e3-8a54-6c68cdb24bf0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:10.949981 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-837a1707-2966-41e3-8a54-6c68cdb24bf0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:10.950414 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-837a1707-2966-41e3-8a54-6c68cdb24bf0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:11.094261 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-837a1707-2966-41e3-8a54-6c68cdb24bf0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:04:11.102352 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-837a1707-2966-41e3-8a54-6c68cdb24bf0 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1443 microversion: 2.1 time: 0.168266 Sep 11 01:04:11.102913 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 477/935] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:04:10 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1443 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:04:11.124358 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f460f1ee-c73b-4239-a3df-afcc744d3650 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:04:11.124936 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f460f1ee-c73b-4239-a3df-afcc744d3650 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:04:11.131922 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f460f1ee-c73b-4239-a3df-afcc744d3650 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:11.132405 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f460f1ee-c73b-4239-a3df-afcc744d3650 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:11.132837 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f460f1ee-c73b-4239-a3df-afcc744d3650 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:11.133521 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f460f1ee-c73b-4239-a3df-afcc744d3650 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:11.133969 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f460f1ee-c73b-4239-a3df-afcc744d3650 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:11.134393 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f460f1ee-c73b-4239-a3df-afcc744d3650 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:11.268345 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-f460f1ee-c73b-4239-a3df-afcc744d3650 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:04:11.280218 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f460f1ee-c73b-4239-a3df-afcc744d3650 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1443 microversion: 2.1 time: 0.159431 Sep 11 01:04:11.280944 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 459/936] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:04:11 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1443 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:04:13.004310 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [req-439afced-3c70-41d2-995d-c0b71b1b851c req-f3b27620-e621-4f70-8502-0878f7a86762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80717588-ea72-4197-9e6d-c0661eadb3d0", "tag": "baba8f61-84fd-4633-a26f-d02e2b3b7e4a"}]} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:04:13.014614 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-439afced-3c70-41d2-995d-c0b71b1b851c req-f3b27620-e621-4f70-8502-0878f7a86762 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:04:13.015091 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-439afced-3c70-41d2-995d-c0b71b1b851c req-f3b27620-e621-4f70-8502-0878f7a86762 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:04:13.015554 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [req-439afced-3c70-41d2-995d-c0b71b1b851c req-f3b27620-e621-4f70-8502-0878f7a86762 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:04:13.027202 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.compute.server_external_events [req-439afced-3c70-41d2-995d-c0b71b1b851c req-f3b27620-e621-4f70-8502-0878f7a86762 service nova] Creating event network-changed:baba8f61-84fd-4633-a26f-d02e2b3b7e4a for instance 80717588-ea72-4197-9e6d-c0661eadb3d0 on hv-cinder-maste Sep 11 01:04:13.032429 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [req-439afced-3c70-41d2-995d-c0b71b1b851c req-f3b27620-e621-4f70-8502-0878f7a86762 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031871 Sep 11 01:04:13.033325 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 478/937] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:06:07.161300 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 11 01:06:07.162253 dv-cinder-master-3-smb devstack@n-api.service[120496]: Sun Sep 11 01:06:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0/action (ip 10.222.0.23) !!! Sep 11 01:06:07.163947 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:07.165125 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=36 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:07.172714 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a4d90c96-542c-4286-bad4-fc79eab3024a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:06:07.173250 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a4d90c96-542c-4286-bad4-fc79eab3024a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:07.182153 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a4d90c96-542c-4286-bad4-fc79eab3024a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:07.182861 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a4d90c96-542c-4286-bad4-fc79eab3024a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:07.183327 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a4d90c96-542c-4286-bad4-fc79eab3024a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:07.184027 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a4d90c96-542c-4286-bad4-fc79eab3024a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:07.184482 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a4d90c96-542c-4286-bad4-fc79eab3024a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:07.184910 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a4d90c96-542c-4286-bad4-fc79eab3024a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:07.210864 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-a4d90c96-542c-4286-bad4-fc79eab3024a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lazy-loading 'flavor' on Instance uuid 80717588-ea72-4197-9e6d-c0661eadb3d0 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:06:07.287939 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a4d90c96-542c-4286-bad4-fc79eab3024a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "POST /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0/action" status: 202 len: 0 microversion: 2.1 time: 0.130712 Sep 11 01:06:07.288594 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 460/938] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Sep 11 01:06:07 2022] POST /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:06:07.295679 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 11 01:06:07.296230 dv-cinder-master-3-smb devstack@n-api.service[120497]: Sun Sep 11 01:06:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 (ip 10.222.0.23) !!! Sep 11 01:06:07.297463 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 01:06:07.297614 dv-cinder-master-3-smb devstack@n-api.service[120497]: Sun Sep 11 01:06:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 (ip 10.222.0.23) !!! Sep 11 01:06:07.298946 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=18 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:07.299505 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=38 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:07.305692 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-daef038e-eb4c-4db4-813c-028fa9914038 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:07.307450 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-daef038e-eb4c-4db4-813c-028fa9914038 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:07.317440 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-daef038e-eb4c-4db4-813c-028fa9914038 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:07.317959 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-daef038e-eb4c-4db4-813c-028fa9914038 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:07.318396 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-daef038e-eb4c-4db4-813c-028fa9914038 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:07.319108 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-daef038e-eb4c-4db4-813c-028fa9914038 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:07.319584 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-daef038e-eb4c-4db4-813c-028fa9914038 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:07.320012 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-daef038e-eb4c-4db4-813c-028fa9914038 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:07.512780 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-daef038e-eb4c-4db4-813c-028fa9914038 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:07.520944 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-daef038e-eb4c-4db4-813c-028fa9914038 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1567 microversion: 2.1 time: 0.227856 Sep 11 01:06:07.521490 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 479/939] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:07 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:08.547543 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-400f024c-cbcf-4717-9868-57e042fbefd6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:08.548307 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-400f024c-cbcf-4717-9868-57e042fbefd6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:08.556271 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-400f024c-cbcf-4717-9868-57e042fbefd6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:08.556872 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-400f024c-cbcf-4717-9868-57e042fbefd6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:08.557414 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-400f024c-cbcf-4717-9868-57e042fbefd6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:08.558275 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-400f024c-cbcf-4717-9868-57e042fbefd6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:08.558837 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-400f024c-cbcf-4717-9868-57e042fbefd6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:08.559397 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-400f024c-cbcf-4717-9868-57e042fbefd6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:08.753249 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-400f024c-cbcf-4717-9868-57e042fbefd6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:08.761199 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-400f024c-cbcf-4717-9868-57e042fbefd6 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1567 microversion: 2.1 time: 0.219941 Sep 11 01:06:08.761764 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 461/940] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:08 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:09.789176 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-28db9360-d971-4684-b43e-33aec68470f7 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:09.790334 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-28db9360-d971-4684-b43e-33aec68470f7 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:09.800754 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-28db9360-d971-4684-b43e-33aec68470f7 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:09.801236 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-28db9360-d971-4684-b43e-33aec68470f7 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:09.801667 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-28db9360-d971-4684-b43e-33aec68470f7 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:09.802361 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-28db9360-d971-4684-b43e-33aec68470f7 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:09.802807 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-28db9360-d971-4684-b43e-33aec68470f7 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:09.803231 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-28db9360-d971-4684-b43e-33aec68470f7 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:09.940999 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-28db9360-d971-4684-b43e-33aec68470f7 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:09.949282 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-28db9360-d971-4684-b43e-33aec68470f7 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1567 microversion: 2.1 time: 0.167189 Sep 11 01:06:09.949849 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 480/941] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:09 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:10.976680 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-918fd1a1-2313-440a-b3b8-106f33009bdf tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:10.977726 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-918fd1a1-2313-440a-b3b8-106f33009bdf tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:10.987937 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-918fd1a1-2313-440a-b3b8-106f33009bdf tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:10.988349 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-918fd1a1-2313-440a-b3b8-106f33009bdf tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:10.988776 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-918fd1a1-2313-440a-b3b8-106f33009bdf tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:10.989463 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-918fd1a1-2313-440a-b3b8-106f33009bdf tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:10.989948 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-918fd1a1-2313-440a-b3b8-106f33009bdf tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:10.990355 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-918fd1a1-2313-440a-b3b8-106f33009bdf tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:11.135810 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-918fd1a1-2313-440a-b3b8-106f33009bdf tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:11.144226 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-918fd1a1-2313-440a-b3b8-106f33009bdf tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1567 microversion: 2.1 time: 0.174181 Sep 11 01:06:11.144797 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 462/942] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:10 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:12.167893 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-dec0694c-e50f-4351-bbda-2e378680d330 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:12.168490 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-dec0694c-e50f-4351-bbda-2e378680d330 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:12.175685 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dec0694c-e50f-4351-bbda-2e378680d330 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:12.176165 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dec0694c-e50f-4351-bbda-2e378680d330 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:12.176599 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dec0694c-e50f-4351-bbda-2e378680d330 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:12.177288 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dec0694c-e50f-4351-bbda-2e378680d330 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:12.177722 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dec0694c-e50f-4351-bbda-2e378680d330 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:12.178184 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dec0694c-e50f-4351-bbda-2e378680d330 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:12.321130 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-dec0694c-e50f-4351-bbda-2e378680d330 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:12.333061 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-dec0694c-e50f-4351-bbda-2e378680d330 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1567 microversion: 2.1 time: 0.168785 Sep 11 01:06:12.333742 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 481/943] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:12 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:13.360897 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d27e57b7-fb63-4c2d-b080-cc2307573109 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:13.361909 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d27e57b7-fb63-4c2d-b080-cc2307573109 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:13.369396 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d27e57b7-fb63-4c2d-b080-cc2307573109 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:13.369907 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d27e57b7-fb63-4c2d-b080-cc2307573109 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:13.370362 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d27e57b7-fb63-4c2d-b080-cc2307573109 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:13.371093 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d27e57b7-fb63-4c2d-b080-cc2307573109 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:13.371611 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d27e57b7-fb63-4c2d-b080-cc2307573109 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:13.372054 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d27e57b7-fb63-4c2d-b080-cc2307573109 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:13.508607 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-d27e57b7-fb63-4c2d-b080-cc2307573109 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:13.516798 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d27e57b7-fb63-4c2d-b080-cc2307573109 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1567 microversion: 2.1 time: 0.162635 Sep 11 01:06:13.517410 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 463/944] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:13 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:14.541513 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-3b431a14-b741-42a2-bfca-94473f50fd18 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:14.542128 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-3b431a14-b741-42a2-bfca-94473f50fd18 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:14.549039 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b431a14-b741-42a2-bfca-94473f50fd18 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:14.549532 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b431a14-b741-42a2-bfca-94473f50fd18 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:14.549972 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b431a14-b741-42a2-bfca-94473f50fd18 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:14.550667 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b431a14-b741-42a2-bfca-94473f50fd18 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:14.551122 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b431a14-b741-42a2-bfca-94473f50fd18 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:14.551587 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-3b431a14-b741-42a2-bfca-94473f50fd18 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:14.699050 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-3b431a14-b741-42a2-bfca-94473f50fd18 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:14.706965 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-3b431a14-b741-42a2-bfca-94473f50fd18 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1567 microversion: 2.1 time: 0.169320 Sep 11 01:06:14.707568 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 482/945] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:14 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:15.734696 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e3b17264-7cb8-4e52-9c0d-a37d45c3cd43 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:15.735714 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e3b17264-7cb8-4e52-9c0d-a37d45c3cd43 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:15.743672 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3b17264-7cb8-4e52-9c0d-a37d45c3cd43 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:15.744152 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3b17264-7cb8-4e52-9c0d-a37d45c3cd43 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:15.744580 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3b17264-7cb8-4e52-9c0d-a37d45c3cd43 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:15.745270 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3b17264-7cb8-4e52-9c0d-a37d45c3cd43 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:15.745708 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3b17264-7cb8-4e52-9c0d-a37d45c3cd43 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:15.746126 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3b17264-7cb8-4e52-9c0d-a37d45c3cd43 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:15.883589 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-e3b17264-7cb8-4e52-9c0d-a37d45c3cd43 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:15.896028 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e3b17264-7cb8-4e52-9c0d-a37d45c3cd43 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1567 microversion: 2.1 time: 0.167853 Sep 11 01:06:15.896874 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 464/946] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:15 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:16.928415 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-189f2ee1-956f-4dc8-9ff4-545e4040cd5a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:16.929462 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-189f2ee1-956f-4dc8-9ff4-545e4040cd5a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:16.940339 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-189f2ee1-956f-4dc8-9ff4-545e4040cd5a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:16.941278 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-189f2ee1-956f-4dc8-9ff4-545e4040cd5a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:16.941748 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-189f2ee1-956f-4dc8-9ff4-545e4040cd5a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:16.942460 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-189f2ee1-956f-4dc8-9ff4-545e4040cd5a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:16.942905 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-189f2ee1-956f-4dc8-9ff4-545e4040cd5a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:16.943366 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-189f2ee1-956f-4dc8-9ff4-545e4040cd5a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:17.084997 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-189f2ee1-956f-4dc8-9ff4-545e4040cd5a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:17.097138 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-189f2ee1-956f-4dc8-9ff4-545e4040cd5a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1567 microversion: 2.1 time: 0.175224 Sep 11 01:06:17.097898 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 483/947] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:16 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:18.127054 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8a7f8696-0fbc-49ca-82e0-5ad4f7ef6b11 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:18.127732 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8a7f8696-0fbc-49ca-82e0-5ad4f7ef6b11 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:18.134541 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a7f8696-0fbc-49ca-82e0-5ad4f7ef6b11 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:18.135025 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a7f8696-0fbc-49ca-82e0-5ad4f7ef6b11 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:18.135493 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a7f8696-0fbc-49ca-82e0-5ad4f7ef6b11 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:18.136194 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a7f8696-0fbc-49ca-82e0-5ad4f7ef6b11 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:18.136635 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a7f8696-0fbc-49ca-82e0-5ad4f7ef6b11 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:18.137053 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a7f8696-0fbc-49ca-82e0-5ad4f7ef6b11 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:18.268468 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-8a7f8696-0fbc-49ca-82e0-5ad4f7ef6b11 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:18.276855 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8a7f8696-0fbc-49ca-82e0-5ad4f7ef6b11 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1567 microversion: 2.1 time: 0.153814 Sep 11 01:06:18.277430 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 465/948] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:18 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:19.303893 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-d96c8093-f1d3-4398-a4a6-a80dd34f42d1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:19.304659 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-d96c8093-f1d3-4398-a4a6-a80dd34f42d1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:19.313337 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d96c8093-f1d3-4398-a4a6-a80dd34f42d1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:19.313916 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d96c8093-f1d3-4398-a4a6-a80dd34f42d1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:19.314477 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d96c8093-f1d3-4398-a4a6-a80dd34f42d1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:19.315381 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d96c8093-f1d3-4398-a4a6-a80dd34f42d1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:19.315946 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d96c8093-f1d3-4398-a4a6-a80dd34f42d1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:19.316473 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-d96c8093-f1d3-4398-a4a6-a80dd34f42d1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:19.456016 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-d96c8093-f1d3-4398-a4a6-a80dd34f42d1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:19.464593 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-d96c8093-f1d3-4398-a4a6-a80dd34f42d1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1567 microversion: 2.1 time: 0.166515 Sep 11 01:06:19.465139 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 484/949] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:19 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:20.492074 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ff05128a-1370-42ce-9da3-417a64a81505 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:20.492993 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ff05128a-1370-42ce-9da3-417a64a81505 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:20.504013 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff05128a-1370-42ce-9da3-417a64a81505 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:20.504860 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff05128a-1370-42ce-9da3-417a64a81505 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:20.505313 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff05128a-1370-42ce-9da3-417a64a81505 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:20.505989 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff05128a-1370-42ce-9da3-417a64a81505 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:20.506441 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff05128a-1370-42ce-9da3-417a64a81505 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:20.506863 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ff05128a-1370-42ce-9da3-417a64a81505 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:20.660151 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-ff05128a-1370-42ce-9da3-417a64a81505 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:20.668681 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ff05128a-1370-42ce-9da3-417a64a81505 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1508 microversion: 2.1 time: 0.183402 Sep 11 01:06:20.669252 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 466/950] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:20 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:20.691225 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-dc1a1c8c-2a40-4e6e-838b-029710991232 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:06:20.691839 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-dc1a1c8c-2a40-4e6e-838b-029710991232 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:20.698952 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dc1a1c8c-2a40-4e6e-838b-029710991232 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:20.699470 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dc1a1c8c-2a40-4e6e-838b-029710991232 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:20.699909 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dc1a1c8c-2a40-4e6e-838b-029710991232 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:20.700603 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dc1a1c8c-2a40-4e6e-838b-029710991232 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:20.701052 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dc1a1c8c-2a40-4e6e-838b-029710991232 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:20.701475 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-dc1a1c8c-2a40-4e6e-838b-029710991232 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:20.731039 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-dc1a1c8c-2a40-4e6e-838b-029710991232 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120497) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 01:06:20.799519 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-dc1a1c8c-2a40-4e6e-838b-029710991232 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "POST /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0/action" status: 202 len: 0 microversion: 2.1 time: 0.112074 Sep 11 01:06:20.800056 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 485/951] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Sep 11 01:06:20 2022] POST /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 01:06:20.808220 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7f3dbdbe-7384-4f8d-a894-fd3d42d7b896 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:20.808827 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7f3dbdbe-7384-4f8d-a894-fd3d42d7b896 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:20.815141 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7f3dbdbe-7384-4f8d-a894-fd3d42d7b896 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:20.815657 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7f3dbdbe-7384-4f8d-a894-fd3d42d7b896 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:20.816077 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7f3dbdbe-7384-4f8d-a894-fd3d42d7b896 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:20.816789 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7f3dbdbe-7384-4f8d-a894-fd3d42d7b896 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:20.817244 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7f3dbdbe-7384-4f8d-a894-fd3d42d7b896 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:20.817660 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7f3dbdbe-7384-4f8d-a894-fd3d42d7b896 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:20.954193 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-7f3dbdbe-7384-4f8d-a894-fd3d42d7b896 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:20.962683 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7f3dbdbe-7384-4f8d-a894-fd3d42d7b896 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1516 microversion: 2.1 time: 0.158305 Sep 11 01:06:20.963254 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 467/952] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:20 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:21.989515 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-12ac36ee-069a-4772-b046-b4c84050cf06 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:21.990399 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-12ac36ee-069a-4772-b046-b4c84050cf06 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:21.998043 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-12ac36ee-069a-4772-b046-b4c84050cf06 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:21.998684 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-12ac36ee-069a-4772-b046-b4c84050cf06 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:21.999310 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-12ac36ee-069a-4772-b046-b4c84050cf06 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:22.000072 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-12ac36ee-069a-4772-b046-b4c84050cf06 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:22.000746 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-12ac36ee-069a-4772-b046-b4c84050cf06 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:22.001163 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-12ac36ee-069a-4772-b046-b4c84050cf06 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:22.151106 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-12ac36ee-069a-4772-b046-b4c84050cf06 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:22.159530 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-12ac36ee-069a-4772-b046-b4c84050cf06 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1574 microversion: 2.1 time: 0.177228 Sep 11 01:06:22.160136 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 486/953] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:21 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:23.180803 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-125eb0b9-fbd4-40f4-aa1d-4d2c93754871 req-9667db24-e088-4bb5-a8a6-7851f676ba57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80717588-ea72-4197-9e6d-c0661eadb3d0", "name": "network-vif-unplugged", "status": "completed", "tag": "baba8f61-84fd-4633-a26f-d02e2b3b7e4a"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:06:23.185111 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-1fe3209b-3815-42c4-b891-d999ce00fd71 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:23.186028 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-1fe3209b-3815-42c4-b891-d999ce00fd71 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:23.192481 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-125eb0b9-fbd4-40f4-aa1d-4d2c93754871 req-9667db24-e088-4bb5-a8a6-7851f676ba57 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:23.192968 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-125eb0b9-fbd4-40f4-aa1d-4d2c93754871 req-9667db24-e088-4bb5-a8a6-7851f676ba57 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:23.193487 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-125eb0b9-fbd4-40f4-aa1d-4d2c93754871 req-9667db24-e088-4bb5-a8a6-7851f676ba57 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:23.194713 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fe3209b-3815-42c4-b891-d999ce00fd71 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:23.195227 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fe3209b-3815-42c4-b891-d999ce00fd71 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:23.195665 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fe3209b-3815-42c4-b891-d999ce00fd71 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:23.196368 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fe3209b-3815-42c4-b891-d999ce00fd71 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:23.196819 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fe3209b-3815-42c4-b891-d999ce00fd71 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:23.197238 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-1fe3209b-3815-42c4-b891-d999ce00fd71 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:23.205863 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-125eb0b9-fbd4-40f4-aa1d-4d2c93754871 req-9667db24-e088-4bb5-a8a6-7851f676ba57 service nova] Creating event network-vif-unplugged:baba8f61-84fd-4633-a26f-d02e2b3b7e4a for instance 80717588-ea72-4197-9e6d-c0661eadb3d0 on hv-cinder-maste Sep 11 01:06:23.211427 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-125eb0b9-fbd4-40f4-aa1d-4d2c93754871 req-9667db24-e088-4bb5-a8a6-7851f676ba57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036714 Sep 11 01:06:23.212076 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 468/954] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:06:23.337767 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-1fe3209b-3815-42c4-b891-d999ce00fd71 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:23.350565 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-1fe3209b-3815-42c4-b891-d999ce00fd71 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1574 microversion: 2.1 time: 0.170793 Sep 11 01:06:23.351126 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 487/955] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:23 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:24.397287 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c0fa2347-5dc7-4361-bf0a-ef0fd28c9bb1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:24.398024 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c0fa2347-5dc7-4361-bf0a-ef0fd28c9bb1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:24.405064 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0fa2347-5dc7-4361-bf0a-ef0fd28c9bb1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:24.405573 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0fa2347-5dc7-4361-bf0a-ef0fd28c9bb1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:24.406029 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0fa2347-5dc7-4361-bf0a-ef0fd28c9bb1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:24.406754 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0fa2347-5dc7-4361-bf0a-ef0fd28c9bb1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:24.407229 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0fa2347-5dc7-4361-bf0a-ef0fd28c9bb1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:24.408070 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0fa2347-5dc7-4361-bf0a-ef0fd28c9bb1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:24.541800 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-c0fa2347-5dc7-4361-bf0a-ef0fd28c9bb1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:24.550197 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c0fa2347-5dc7-4361-bf0a-ef0fd28c9bb1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1574 microversion: 2.1 time: 0.160872 Sep 11 01:06:24.550737 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 469/956] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:24 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:25.573664 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-db227c2e-de52-42c4-bc6a-a7b34d804a88 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:06:25.574297 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-db227c2e-de52-42c4-bc6a-a7b34d804a88 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:06:25.581158 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-db227c2e-de52-42c4-bc6a-a7b34d804a88 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:25.581643 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-db227c2e-de52-42c4-bc6a-a7b34d804a88 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:25.582079 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-db227c2e-de52-42c4-bc6a-a7b34d804a88 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:25.582778 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-db227c2e-de52-42c4-bc6a-a7b34d804a88 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:25.583324 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-db227c2e-de52-42c4-bc6a-a7b34d804a88 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:25.583923 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-db227c2e-de52-42c4-bc6a-a7b34d804a88 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:25.725736 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-db227c2e-de52-42c4-bc6a-a7b34d804a88 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:06:25.734191 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-db227c2e-de52-42c4-bc6a-a7b34d804a88 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1561 microversion: 2.1 time: 0.164426 Sep 11 01:06:25.734742 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 488/957] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:06:25 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:06:27.267773 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-b50f48ef-fdef-4b2c-8133-4908da1b7e3f req-ec745c45-13e9-41bb-af41-a3d363f483c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80717588-ea72-4197-9e6d-c0661eadb3d0", "name": "network-vif-plugged", "status": "completed", "tag": "baba8f61-84fd-4633-a26f-d02e2b3b7e4a"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:06:27.279274 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-b50f48ef-fdef-4b2c-8133-4908da1b7e3f req-ec745c45-13e9-41bb-af41-a3d363f483c2 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:06:27.279792 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-b50f48ef-fdef-4b2c-8133-4908da1b7e3f req-ec745c45-13e9-41bb-af41-a3d363f483c2 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:06:27.280298 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-b50f48ef-fdef-4b2c-8133-4908da1b7e3f req-ec745c45-13e9-41bb-af41-a3d363f483c2 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:06:27.295326 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-b50f48ef-fdef-4b2c-8133-4908da1b7e3f req-ec745c45-13e9-41bb-af41-a3d363f483c2 service nova] Creating event network-vif-plugged:baba8f61-84fd-4633-a26f-d02e2b3b7e4a for instance 80717588-ea72-4197-9e6d-c0661eadb3d0 on hv-cinder-maste Sep 11 01:06:27.300542 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-b50f48ef-fdef-4b2c-8133-4908da1b7e3f req-ec745c45-13e9-41bb-af41-a3d363f483c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036697 Sep 11 01:06:27.301422 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 470/958] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:07:36.360302 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:36.361778 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG dbcounter [-] [120497] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:36.363465 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=22 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:36.364203 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:36.368209 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-f738a917-35df-439a-83e6-3b599308aa23 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:07:36.369176 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f738a917-35df-439a-83e6-3b599308aa23 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:07:36.378141 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f738a917-35df-439a-83e6-3b599308aa23 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:07:36.378936 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f738a917-35df-439a-83e6-3b599308aa23 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:07:36.379763 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f738a917-35df-439a-83e6-3b599308aa23 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:07:36.380877 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f738a917-35df-439a-83e6-3b599308aa23 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:07:36.381327 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f738a917-35df-439a-83e6-3b599308aa23 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:07:36.382972 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-f738a917-35df-439a-83e6-3b599308aa23 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:07:36.412244 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-f738a917-35df-439a-83e6-3b599308aa23 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Going to try to terminate instance {{(pid=120497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 01:07:36.437179 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-e337f1e1-a12b-43b0-81c5-06cc8b4190cf req-0aa976a7-08a6-46d1-999e-f073f558ed17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80717588-ea72-4197-9e6d-c0661eadb3d0", "tag": "baba8f61-84fd-4633-a26f-d02e2b3b7e4a"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:07:36.447938 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-e337f1e1-a12b-43b0-81c5-06cc8b4190cf req-0aa976a7-08a6-46d1-999e-f073f558ed17 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:07:36.448678 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-e337f1e1-a12b-43b0-81c5-06cc8b4190cf req-0aa976a7-08a6-46d1-999e-f073f558ed17 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:07:36.449198 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-e337f1e1-a12b-43b0-81c5-06cc8b4190cf req-0aa976a7-08a6-46d1-999e-f073f558ed17 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:07:36.461315 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-e337f1e1-a12b-43b0-81c5-06cc8b4190cf req-0aa976a7-08a6-46d1-999e-f073f558ed17 service nova] Creating event network-changed:baba8f61-84fd-4633-a26f-d02e2b3b7e4a for instance 80717588-ea72-4197-9e6d-c0661eadb3d0 on hv-cinder-maste Sep 11 01:07:36.466930 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-e337f1e1-a12b-43b0-81c5-06cc8b4190cf req-0aa976a7-08a6-46d1-999e-f073f558ed17 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105168 Sep 11 01:07:36.467603 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 471/959] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 01:07:36.475292 dv-cinder-master-3-smb devstack@n-api.service[120497]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f738a917-35df-439a-83e6-3b599308aa23 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [cc0c7e1d-091a-4340-a580-152522d18239] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 11 01:07:37.488164 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO oslo.messaging._drivers.impl_rabbit [None req-f738a917-35df-439a-83e6-3b599308aa23 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [cc0c7e1d-091a-4340-a580-152522d18239] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 53384. Sep 11 01:07:37.516282 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-f738a917-35df-439a-83e6-3b599308aa23 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "DELETE /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 204 len: 0 microversion: 2.1 time: 1.158659 Sep 11 01:07:37.517233 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 489/960] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Sep 11 01:07:36 2022] DELETE /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 0 bytes in 1160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 01:07:37.530043 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a910f05b-6ded-4923-917a-c59aedfc4c6a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:07:37.530679 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a910f05b-6ded-4923-917a-c59aedfc4c6a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:07:37.537709 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a910f05b-6ded-4923-917a-c59aedfc4c6a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:07:37.538184 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a910f05b-6ded-4923-917a-c59aedfc4c6a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:07:37.538620 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a910f05b-6ded-4923-917a-c59aedfc4c6a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:07:37.539350 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a910f05b-6ded-4923-917a-c59aedfc4c6a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:07:37.539806 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a910f05b-6ded-4923-917a-c59aedfc4c6a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:07:37.540226 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a910f05b-6ded-4923-917a-c59aedfc4c6a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:07:37.672496 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.policy [None req-a910f05b-6ded-4923-917a-c59aedfc4c6a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:07:37.680791 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a910f05b-6ded-4923-917a-c59aedfc4c6a tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1449 microversion: 2.1 time: 0.158390 Sep 11 01:07:37.681353 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 472/961] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:07:37 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:07:38.708288 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-95943aad-0e2c-484b-b026-ad30ded14e0c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:07:38.709036 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-95943aad-0e2c-484b-b026-ad30ded14e0c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:07:38.716714 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-95943aad-0e2c-484b-b026-ad30ded14e0c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:07:38.717195 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-95943aad-0e2c-484b-b026-ad30ded14e0c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:07:38.717631 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-95943aad-0e2c-484b-b026-ad30ded14e0c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:07:38.718323 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-95943aad-0e2c-484b-b026-ad30ded14e0c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:07:38.718771 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-95943aad-0e2c-484b-b026-ad30ded14e0c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:07:38.719214 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-95943aad-0e2c-484b-b026-ad30ded14e0c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:07:38.878997 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-95943aad-0e2c-484b-b026-ad30ded14e0c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:07:38.886906 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-95943aad-0e2c-484b-b026-ad30ded14e0c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1449 microversion: 2.1 time: 0.183814 Sep 11 01:07:38.887529 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 490/962] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:07:38 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1449 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:07:39.606785 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-c2adb513-0ae7-46a5-b308-280e355348b5 req-4a3f49d5-f030-402b-bb98-d98b5bda4924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80717588-ea72-4197-9e6d-c0661eadb3d0", "name": "network-vif-deleted", "tag": "baba8f61-84fd-4633-a26f-d02e2b3b7e4a"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 01:07:39.618960 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c2adb513-0ae7-46a5-b308-280e355348b5 req-4a3f49d5-f030-402b-bb98-d98b5bda4924 service nova] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:07:39.619485 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c2adb513-0ae7-46a5-b308-280e355348b5 req-4a3f49d5-f030-402b-bb98-d98b5bda4924 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:07:39.619915 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c2adb513-0ae7-46a5-b308-280e355348b5 req-4a3f49d5-f030-402b-bb98-d98b5bda4924 service nova] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:07:39.631723 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-c2adb513-0ae7-46a5-b308-280e355348b5 req-4a3f49d5-f030-402b-bb98-d98b5bda4924 service nova] Creating event network-vif-deleted:baba8f61-84fd-4633-a26f-d02e2b3b7e4a for instance 80717588-ea72-4197-9e6d-c0661eadb3d0 on hv-cinder-maste Sep 11 01:07:39.636453 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-c2adb513-0ae7-46a5-b308-280e355348b5 req-4a3f49d5-f030-402b-bb98-d98b5bda4924 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092785 Sep 11 01:07:39.637046 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 473/963] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Sep 11 01:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 01:07:39.917930 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-adf684c9-16f1-4889-bb47-4b0de6b8a37c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:07:39.919141 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.compute.api [None req-adf684c9-16f1-4889-bb47-4b0de6b8a37c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:07:39.927235 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-adf684c9-16f1-4889-bb47-4b0de6b8a37c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:07:39.928068 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-adf684c9-16f1-4889-bb47-4b0de6b8a37c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:07:39.928716 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-adf684c9-16f1-4889-bb47-4b0de6b8a37c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:07:39.929439 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-adf684c9-16f1-4889-bb47-4b0de6b8a37c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:07:39.929904 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-adf684c9-16f1-4889-bb47-4b0de6b8a37c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:07:39.930357 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-adf684c9-16f1-4889-bb47-4b0de6b8a37c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:07:39.965638 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-adf684c9-16f1-4889-bb47-4b0de6b8a37c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:07:39.966126 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-adf684c9-16f1-4889-bb47-4b0de6b8a37c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:07:39.966623 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG oslo_concurrency.lockutils [None req-adf684c9-16f1-4889-bb47-4b0de6b8a37c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:07:39.967076 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.objects.instance [None req-adf684c9-16f1-4889-bb47-4b0de6b8a37c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lazy-loading 'fault' on Instance uuid 80717588-ea72-4197-9e6d-c0661eadb3d0 {{(pid=120497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 01:07:40.011546 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.policy [None req-adf684c9-16f1-4889-bb47-4b0de6b8a37c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97d41a8f1ff40e79472aa4bf9790ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b47e4ca8c0414790b8d0fa30559d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 01:07:40.019332 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-adf684c9-16f1-4889-bb47-4b0de6b8a37c tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 200 len: 1224 microversion: 2.1 time: 0.105406 Sep 11 01:07:40.019994 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 491/964] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:07:39 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 01:07:41.047971 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8f0d595e-b9e9-49d3-9c26-f295c766137d tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:07:41.049042 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8f0d595e-b9e9-49d3-9c26-f295c766137d tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] [instance: 80717588-ea72-4197-9e6d-c0661eadb3d0] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 01:07:41.059646 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8f0d595e-b9e9-49d3-9c26-f295c766137d tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:07:41.060439 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8f0d595e-b9e9-49d3-9c26-f295c766137d tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:07:41.061157 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8f0d595e-b9e9-49d3-9c26-f295c766137d tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:07:41.062296 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8f0d595e-b9e9-49d3-9c26-f295c766137d tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Acquiring lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 01:07:41.063051 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8f0d595e-b9e9-49d3-9c26-f295c766137d tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 01:07:41.063807 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8f0d595e-b9e9-49d3-9c26-f295c766137d tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Lock "b8719ce5-7462-4db4-8ae0-e38f988a1e8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 01:07:41.077644 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-8f0d595e-b9e9-49d3-9c26-f295c766137d tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] HTTP exception thrown: Instance 80717588-ea72-4197-9e6d-c0661eadb3d0 could not be found. Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8f0d595e-b9e9-49d3-9c26-f295c766137d tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Request method failure captured: Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 HTTP/1.1 Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept: application/json Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: Accept-Encoding: identity Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: Connection: close Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Length: 0 Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: Content-Type: application/json Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: Host: 10.222.0.23 Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: Openstack-System-Scope: None Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjHTPqFHDbYE5R7RJG5PQJXCrC602B6eRAGZySwc28Upwnc4Sm0joTG_xdc0bvlEKRyoaVcYJj_7vRTCC-1q3VpBZoGkTeCIQ9Bf7sb-G0JEW2LIXpigWt1K3QgB0NFMmF4UXN-rGOxGua7uD3Xtq6Ta9dZp0a3j3AHA2Y7BEiS9GbbMo Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Id: None Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Domain-Name: None Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Identity-Status: Confirmed Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Is-Admin-Project: True Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Id: default Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Domain-Name: Default Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Id: e7b47e4ca8c0414790b8d0fa30559d25 Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Project-Name: tempest-TestShelveInstance-1505910670 Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Role: member,reader Sep 11 01:07:41.079292 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Roles: member,reader Sep 11 01:07:41.081058 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7b47e4ca8c0414790b8d0fa30559d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7b47e4ca8c0414790b8d0fa30559d25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7b47e4ca8c0414790b8d0fa30559d25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7b47e4ca8c0414790b8d0fa30559d25", "adminURL": "http://10.222.0.23:8080"}]}] Sep 11 01:07:41.081058 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant: tempest-TestShelveInstance-1505910670 Sep 11 01:07:41.081058 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Id: e7b47e4ca8c0414790b8d0fa30559d25 Sep 11 01:07:41.081058 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-Tenant-Name: tempest-TestShelveInstance-1505910670 Sep 11 01:07:41.081058 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User: tempest-TestShelveInstance-1505910670-project Sep 11 01:07:41.081058 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Id: default Sep 11 01:07:41.081058 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Domain-Name: Default Sep 11 01:07:41.081058 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Id: c97d41a8f1ff40e79472aa4bf9790ae5 Sep 11 01:07:41.081058 dv-cinder-master-3-smb devstack@n-api.service[120496]: X-User-Name: tempest-TestShelveInstance-1505910670-project Sep 11 01:07:41.081058 dv-cinder-master-3-smb devstack@n-api.service[120496]: method: > Sep 11 01:07:41.081058 dv-cinder-master-3-smb devstack@n-api.service[120496]: exception: Instance 80717588-ea72-4197-9e6d-c0661eadb3d0 could not be found. Sep 11 01:07:41.081058 dv-cinder-master-3-smb devstack@n-api.service[120496]: action_args: {'id': '80717588-ea72-4197-9e6d-c0661eadb3d0'} Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80717588-ea72-4197-9e6d-c0661eadb3d0 could not be found. Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 01:07:41.082097 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80717588-ea72-4197-9e6d-c0661eadb3d0 could not be found. Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80717588-ea72-4197-9e6d-c0661eadb3d0 could not be found. Sep 11 01:07:41.083763 dv-cinder-master-3-smb devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Sep 11 01:07:41.085210 dv-cinder-master-3-smb devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8f0d595e-b9e9-49d3-9c26-f295c766137d tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Returning 404 to user: Instance 80717588-ea72-4197-9e6d-c0661eadb3d0 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 01:07:41.085210 dv-cinder-master-3-smb devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8f0d595e-b9e9-49d3-9c26-f295c766137d tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0" status: 404 len: 111 microversion: 2.1 time: 0.041989 Sep 11 01:07:41.085210 dv-cinder-master-3-smb devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 474/965] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Sep 11 01:07:41 2022] GET /compute/v2.1/servers/80717588-ea72-4197-9e6d-c0661eadb3d0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 01:07:41.244403 dv-cinder-master-3-smb devstack@n-api.service[120497]: DEBUG nova.api.openstack.wsgi [None req-fae14c22-72b0-4866-ae32-cceaac42d2e1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] Calling method '.version_select at 0x7fbb907b81f0>' {{(pid=120497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 01:07:41.268935 dv-cinder-master-3-smb devstack@n-api.service[120497]: INFO nova.api.openstack.requestlog [None req-fae14c22-72b0-4866-ae32-cceaac42d2e1 tempest-TestShelveInstance-1505910670 tempest-TestShelveInstance-1505910670-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-862224524" status: 202 len: 0 microversion: 2.1 time: 0.028375 Sep 11 01:07:41.269786 dv-cinder-master-3-smb devstack@n-api.service[120497]: [pid: 120497|app: 0|req: 492/966] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Sep 11 01:07:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-862224524 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)